Jun 09 11:55:15.012133 ip-10-0-141-91 systemd[1]: Starting Kubernetes Kubelet... Jun 09 11:55:15.411078 ip-10-0-141-91 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:55:15.411078 ip-10-0-141-91 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 11:55:15.411078 ip-10-0-141-91 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:55:15.411078 ip-10-0-141-91 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 11:55:15.411078 ip-10-0-141-91 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:55:15.412952 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.412867 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 11:55:15.418032 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418017 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:15.418032 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418032 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418035 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418039 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418042 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418045 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418048 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418051 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418059 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418062 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418065 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418068 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418070 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418073 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418076 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418078 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418081 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418084 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418086 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418089 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418091 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:15.418098 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418094 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418098 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418102 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418105 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418108 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418112 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418114 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418118 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418121 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418123 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418126 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418129 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418131 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418134 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418136 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418139 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418142 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418145 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418148 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:15.418570 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418150 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418153 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418155 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418158 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418161 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418163 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418166 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418168 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418171 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418174 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418176 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418179 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418181 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418184 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418186 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418189 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418192 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418195 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418198 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418201 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:15.419056 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418203 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418205 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418208 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418211 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418227 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418229 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418233 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418235 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418238 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418240 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418244 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418251 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418254 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418257 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418260 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418262 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418265 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418267 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418270 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:15.419546 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418272 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418275 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418277 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418280 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418282 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418285 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418287 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418291 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418298 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418303 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418308 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418326 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418329 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418334 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418337 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418340 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418343 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418346 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418349 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.418352 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:15.420041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419049 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419055 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419058 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419062 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419065 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419069 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419071 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419074 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419077 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419079 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419082 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419084 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419087 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419090 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419092 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419095 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419097 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419100 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419103 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419105 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:15.420534 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419109 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419113 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419116 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419118 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419121 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419124 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419127 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419130 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419133 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419136 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419138 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419141 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419144 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419146 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419149 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419151 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419154 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419157 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419160 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419163 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:15.421043 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419165 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419168 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419170 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419173 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419175 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419178 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419181 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419184 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419186 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419189 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419192 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419194 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419198 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419201 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419203 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419206 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419209 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419211 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419214 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419216 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:15.421536 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419219 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419222 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419224 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419227 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419229 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419232 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419234 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419237 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419239 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419242 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419247 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419251 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419254 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419257 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419260 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419263 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419265 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419268 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419270 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419273 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:15.422057 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419275 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419279 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419282 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419286 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419289 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419292 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419295 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419298 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419301 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419303 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419306 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419308 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419311 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419313 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419316 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419318 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419321 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419323 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419325 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:15.422545 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419670 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419674 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419676 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419679 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419682 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419685 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419688 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419691 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419693 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419696 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419699 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419703 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419707 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419710 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419713 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419717 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419720 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419723 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419725 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419728 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:15.423026 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419740 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419744 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419747 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419750 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419752 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419755 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419758 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419760 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419763 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419766 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419768 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419771 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419774 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419776 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419779 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419781 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419784 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419788 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419790 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419794 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:15.423539 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419796 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419799 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419801 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419804 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419807 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419822 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419826 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419830 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419834 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419837 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419840 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419842 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419845 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419848 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419850 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419855 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419859 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419862 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419865 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:15.424041 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419868 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419871 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419873 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419876 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419879 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419882 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419885 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419887 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419890 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419893 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419895 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419898 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419901 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419903 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419906 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419909 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419912 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419915 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419917 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:15.424515 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419920 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419922 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419925 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419928 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419930 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419933 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419936 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419938 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419941 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419943 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419946 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419949 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419951 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419954 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419957 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419959 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419962 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419965 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419967 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419969 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:15.425063 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.419973 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420048 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420054 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420061 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420065 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420070 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420073 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420077 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420081 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420085 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420088 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420092 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420095 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420098 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420101 2562 flags.go:64] FLAG: --cgroup-root="" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420104 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420107 2562 flags.go:64] FLAG: --client-ca-file="" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420110 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420113 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420119 2562 flags.go:64] FLAG: --cluster-domain="" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420122 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420125 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420129 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420132 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 11:55:15.425556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420136 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420138 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420141 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420144 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420147 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420150 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420153 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420156 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420159 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420165 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420168 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420171 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420174 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420176 2562 flags.go:64] FLAG: --enable-server="true" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420180 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420184 2562 flags.go:64] FLAG: --event-burst="100" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420187 2562 flags.go:64] FLAG: --event-qps="50" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420190 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420193 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420197 2562 flags.go:64] FLAG: --eviction-hard="" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420200 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420203 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420206 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420209 2562 flags.go:64] FLAG: --eviction-soft="" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420212 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 11:55:15.426145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420215 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420218 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420221 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420223 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420226 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420229 2562 flags.go:64] FLAG: --feature-gates="" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420233 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420236 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420239 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420242 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420245 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420248 2562 flags.go:64] FLAG: --help="false" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420251 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420254 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420257 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420260 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420264 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420268 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420271 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420274 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420277 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420280 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420283 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420286 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 11:55:15.426800 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420289 2562 flags.go:64] FLAG: --kube-reserved="" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420292 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420295 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420298 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420301 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420304 2562 flags.go:64] FLAG: --lock-file="" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420307 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420310 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420313 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420318 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420320 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420323 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420326 2562 flags.go:64] FLAG: --logging-format="text" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420329 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420332 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420335 2562 flags.go:64] FLAG: --manifest-url="" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420338 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420342 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420345 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420349 2562 flags.go:64] FLAG: --max-pods="110" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420352 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420355 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420358 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420361 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420365 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 11:55:15.427410 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420368 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420371 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420378 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420381 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420384 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420387 2562 flags.go:64] FLAG: --pod-cidr="" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420391 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420396 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420400 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420403 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420406 2562 flags.go:64] FLAG: --port="10250" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420409 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420411 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e236748e206fb6bc" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420415 2562 flags.go:64] FLAG: --qos-reserved="" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420417 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420420 2562 flags.go:64] FLAG: --register-node="true" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420423 2562 flags.go:64] FLAG: --register-with-taints="" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420426 2562 flags.go:64] FLAG: --registry-burst="10" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420429 2562 flags.go:64] FLAG: --registry-qps="5" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420432 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420435 2562 flags.go:64] FLAG: --reserved-memory="" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420438 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420441 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420444 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420447 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 11:55:15.428122 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420452 2562 flags.go:64] FLAG: --runonce="false" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420455 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420458 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420461 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420464 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420467 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420471 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420474 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420477 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420480 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420483 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420486 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420489 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420492 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420495 2562 flags.go:64] FLAG: --system-cgroups="" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420498 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420504 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420507 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420510 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420514 2562 flags.go:64] FLAG: --tls-min-version="" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420517 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420519 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420522 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420525 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420528 2562 flags.go:64] FLAG: --v="2" Jun 09 11:55:15.428742 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420532 2562 flags.go:64] FLAG: --version="false" Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420536 2562 flags.go:64] FLAG: --vmodule="" Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420540 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420543 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420652 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420657 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420660 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420664 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420667 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420670 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420672 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420675 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420678 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420681 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420684 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420686 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420689 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420691 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420694 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420697 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:15.429374 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420700 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420703 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420709 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420711 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420714 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420717 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420719 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420722 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420726 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420730 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420733 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420736 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420739 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420741 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420744 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420746 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420749 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420752 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420754 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:15.429878 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420759 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420762 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420764 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420767 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420770 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420772 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420776 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420779 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420781 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420784 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420786 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420789 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420792 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420794 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420797 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420799 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420802 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420805 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420808 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420823 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:15.430341 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420826 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420828 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420831 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420834 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420837 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420839 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420842 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420845 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420848 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420850 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420853 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420855 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420859 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420862 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420865 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420868 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420871 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420873 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420876 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420879 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:15.430830 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420881 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420884 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420886 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420889 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420893 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420896 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420899 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420903 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420905 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420909 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420911 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420914 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420917 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420919 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420922 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420924 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420927 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420929 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420932 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:15.431316 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420934 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420937 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420939 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420942 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.420944 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.420951 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.427972 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.427987 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.428834 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.428842 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428900 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428905 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428909 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428912 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428915 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:15.431863 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428920 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428924 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428927 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428931 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428934 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428937 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428940 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428943 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428945 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428948 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428951 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428955 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428958 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428961 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428964 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428967 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428969 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428972 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428974 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428977 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:15.432267 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428980 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428982 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428985 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428987 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428991 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428995 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.428998 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429001 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429004 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429006 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429009 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429012 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429014 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429017 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429019 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429022 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429025 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429028 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429030 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429034 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:15.432753 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429036 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429039 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429041 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429044 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429046 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429049 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429052 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429056 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429060 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429063 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429066 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429068 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429072 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429074 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429077 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429079 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429083 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429087 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429089 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429092 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:15.433424 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429094 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429097 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429100 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429102 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429105 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429107 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429110 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429112 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429115 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429118 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429120 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429123 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429125 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429129 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429133 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429135 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429139 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429141 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429144 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:15.433926 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429146 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429148 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429151 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429153 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429156 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429159 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429161 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429164 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429166 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429169 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429172 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429178 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429181 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429184 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:15.434387 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429186 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.429191 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429305 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429310 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429313 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429316 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429319 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429321 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429324 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429327 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429330 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429332 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429336 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429339 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429341 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:15.434744 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429344 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429346 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429349 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429351 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429354 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429357 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429360 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429363 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429366 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429369 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429372 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429375 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429378 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429382 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429385 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429389 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429392 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429395 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:15.435129 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429397 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429400 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429403 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429406 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429408 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429411 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429413 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429416 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429419 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429421 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429424 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429427 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429431 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429434 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429437 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429441 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429443 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429446 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429449 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:15.435567 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429451 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429454 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429457 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429460 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429463 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429466 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429469 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429471 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429474 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429476 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429478 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429481 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429484 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429486 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429489 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429492 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429494 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429497 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429500 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429502 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:15.436064 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429505 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429507 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429510 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429512 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429515 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429517 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429520 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429523 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429525 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429528 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429530 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429533 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429535 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429538 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429541 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429544 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429546 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429549 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429552 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429554 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:15.436609 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429556 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429559 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429561 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429564 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429567 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429569 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429572 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429574 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:15.429577 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.429582 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.429684 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.431704 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.433257 2562 server.go:1019] "Starting client certificate rotation" Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.433360 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:55:15.437389 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.433415 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:55:15.438080 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.435864 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:55:15.438769 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.438748 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:55:15.449458 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.449439 2562 log.go:25] "Validated CRI v1 runtime API" Jun 09 11:55:15.453784 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.453768 2562 log.go:25] "Validated CRI v1 image API" Jun 09 11:55:15.454594 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.454568 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 11:55:15.457436 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.457410 2562 fs.go:135] Filesystem UUIDs: map[296b88f3-7e82-42e8-a13c-eb0bfd916e11:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b3ade09a-bc47-4b0a-89ad-eb4796fee5c0:/dev/nvme0n1p3] Jun 09 11:55:15.457506 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.457435 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 11:55:15.462522 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.462417 2562 manager.go:216] Machine: {Timestamp:2026-06-09 11:55:15.461129798 +0000 UTC m=+0.333392776 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101814 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f7ea1a5b3fc079c817b38e6f53289 SystemUUID:ec2f7ea1-a5b3-fc07-9c81-7b38e6f53289 BootID:1100a470-8e0f-4731-ad9d-af783f73269a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a7:de:d1:fd:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a7:de:d1:fd:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:c8:02:f5:b7:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 11:55:15.462522 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.462521 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 11:55:15.462643 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.462607 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 11:55:15.465961 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.465939 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 11:55:15.466097 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.465965 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 11:55:15.467205 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.467194 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 11:55:15.467254 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.467211 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 11:55:15.467254 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.467222 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:55:15.467895 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.467884 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:55:15.468683 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.468672 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 11:55:15.471780 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.471768 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:55:15.471915 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.471906 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 11:55:15.471952 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.471938 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 09 11:55:15.471986 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.471952 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 11:55:15.471986 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.471970 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 11:55:15.472036 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.471988 2562 kubelet.go:398] "Adding apiserver pod source" Jun 09 11:55:15.472036 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.472000 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 11:55:15.472558 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.472417 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:55:15.472558 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.472441 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:55:15.473778 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.473761 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:55:15.474612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.474595 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 11:55:15.476524 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.476511 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 11:55:15.476583 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.476540 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 11:55:15.477596 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477583 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 11:55:15.477638 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477604 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 11:55:15.477638 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477612 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 11:55:15.477638 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477619 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 11:55:15.477638 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477629 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 11:55:15.477638 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477636 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 11:55:15.477826 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477646 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 11:55:15.477826 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477653 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 11:55:15.477826 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477662 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 11:55:15.477826 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477671 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 11:55:15.477826 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477687 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 11:55:15.477826 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.477698 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 11:55:15.478808 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.478795 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 11:55:15.478808 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.478806 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 11:55:15.483589 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.483564 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 11:55:15.483668 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.483593 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 11:55:15.483668 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.483605 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 11:55:15.483757 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.483745 2562 server.go:1268] "Started kubelet" Jun 09 11:55:15.483887 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.483856 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 11:55:15.483956 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.483867 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 11:55:15.483956 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.483930 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 11:55:15.484858 ip-10-0-141-91 systemd[1]: Started Kubernetes Kubelet. Jun 09 11:55:15.485585 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.485568 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 11:55:15.485950 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.485937 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 09 11:55:15.489644 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.489627 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 11:55:15.490139 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.489165 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-91.ec2.internal.18b767a038347713 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-91.ec2.internal,UID:ip-10-0-141-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-91.ec2.internal,},FirstTimestamp:2026-06-09 11:55:15.483711251 +0000 UTC m=+0.355974229,LastTimestamp:2026-06-09 11:55:15.483711251 +0000 UTC m=+0.355974229,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-91.ec2.internal,}" Jun 09 11:55:15.490489 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.490469 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 11:55:15.490583 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.490471 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 11:55:15.490583 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.490575 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:15.491166 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491146 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 11:55:15.491166 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491150 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 11:55:15.491298 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491167 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 11:55:15.491298 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491268 2562 factory.go:55] Registering systemd factory Jun 09 11:55:15.491298 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491283 2562 factory.go:223] Registration of the systemd container factory successfully Jun 09 11:55:15.491430 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491362 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 09 11:55:15.491430 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491372 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 09 11:55:15.491533 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491516 2562 factory.go:153] Registering CRI-O factory Jun 09 11:55:15.491533 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491530 2562 factory.go:223] Registration of the crio container factory successfully Jun 09 11:55:15.491673 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491582 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 11:55:15.491673 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491605 2562 factory.go:103] Registering Raw factory Jun 09 11:55:15.491673 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.491621 2562 manager.go:1196] Started watching for new ooms in manager Jun 09 11:55:15.492056 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.492043 2562 manager.go:349] Starting recovery of all containers Jun 09 11:55:15.494838 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.494790 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hz6rd" Jun 09 11:55:15.497155 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.496979 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 11:55:15.497155 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.497029 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 11:55:15.503332 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.503289 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hz6rd" Jun 09 11:55:15.504141 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.504114 2562 manager.go:354] Recovery completed Jun 09 11:55:15.508407 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.508394 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:15.510266 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.510252 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:15.510321 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.510280 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:15.510321 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.510290 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:15.510891 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.510878 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 11:55:15.510891 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.510889 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 11:55:15.510891 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.510890 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:15.511027 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.510903 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:55:15.511502 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.511488 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:15.511551 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.511516 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:15.511551 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.511526 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:15.511927 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.511913 2562 policy_none.go:49] "None policy: Start" Jun 09 11:55:15.511960 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.511934 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 11:55:15.511960 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.511947 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 11:55:15.512592 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.512527 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-91.ec2.internal.18b767a039c9a9cd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-91.ec2.internal,UID:ip-10-0-141-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-91.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-91.ec2.internal,},FirstTimestamp:2026-06-09 11:55:15.510266317 +0000 UTC m=+0.382529298,LastTimestamp:2026-06-09 11:55:15.510266317 +0000 UTC m=+0.382529298,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-91.ec2.internal,}" Jun 09 11:55:15.512987 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.512973 2562 policy_none.go:47] "Start" Jun 09 11:55:15.547400 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.547383 2562 manager.go:337] "Starting Device Plugin manager" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.547415 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.547425 2562 server.go:87] "Starting device plugin registration server" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.547649 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.547660 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.547848 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.547919 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.547926 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.549448 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.549497 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:15.561344 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.560480 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 11:55:15.561915 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.561617 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 11:55:15.561915 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.561650 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 11:55:15.561915 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.561668 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 11:55:15.561915 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.561697 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 11:55:15.563995 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.563972 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:15.648184 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.648161 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:15.649233 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.649215 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:15.649316 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.649248 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:15.649316 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.649259 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:15.649316 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.649297 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.658445 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.658430 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.658491 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.658452 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-91.ec2.internal\": node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:15.662245 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.662206 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal"] Jun 09 11:55:15.662289 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.662263 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:15.663677 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.663663 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:15.663749 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.663690 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:15.663749 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.663700 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:15.664908 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.664896 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:15.665023 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.665005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.665085 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.665041 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:15.665587 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.665569 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:15.665657 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.665597 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:15.665657 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.665609 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:15.665657 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.665578 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:15.665798 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.665672 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:15.665798 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.665688 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:15.667216 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.667198 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.667302 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.667230 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:15.667880 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.667862 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:15.667954 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.667891 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:15.667954 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.667904 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:15.691558 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.691538 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:15.692579 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.692565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8f0d4a1077d563d52f313d9821fb5af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"f8f0d4a1077d563d52f313d9821fb5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.692632 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.692587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f0d4a1077d563d52f313d9821fb5af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"f8f0d4a1077d563d52f313d9821fb5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.692632 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.692607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5da38127d24e86e0bfd6d18050999520-config\") pod \"kube-apiserver-proxy-ip-10-0-141-91.ec2.internal\" (UID: \"5da38127d24e86e0bfd6d18050999520\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.698537 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.698522 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-91.ec2.internal\" not found" node="ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.703132 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.703117 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-91.ec2.internal\" not found" node="ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.792050 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.792024 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:15.793155 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.793135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8f0d4a1077d563d52f313d9821fb5af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"f8f0d4a1077d563d52f313d9821fb5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.793235 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.793170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f0d4a1077d563d52f313d9821fb5af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"f8f0d4a1077d563d52f313d9821fb5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.793235 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.793195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5da38127d24e86e0bfd6d18050999520-config\") pod \"kube-apiserver-proxy-ip-10-0-141-91.ec2.internal\" (UID: \"5da38127d24e86e0bfd6d18050999520\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.793235 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.793218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8f0d4a1077d563d52f313d9821fb5af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"f8f0d4a1077d563d52f313d9821fb5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.793353 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.793251 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f0d4a1077d563d52f313d9821fb5af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"f8f0d4a1077d563d52f313d9821fb5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.793353 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:15.793254 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5da38127d24e86e0bfd6d18050999520-config\") pod \"kube-apiserver-proxy-ip-10-0-141-91.ec2.internal\" (UID: \"5da38127d24e86e0bfd6d18050999520\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jun 09 11:55:15.892495 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.892458 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:15.993251 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:15.993176 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:16.002402 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.002384 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jun 09 11:55:16.009898 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.009880 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jun 09 11:55:16.094251 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:16.094215 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:16.194673 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:16.194645 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:16.295220 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:16.295156 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:16.395569 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:16.395530 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:16.432847 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.432801 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 11:55:16.433434 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.433028 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:55:16.467924 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:16.467884 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da38127d24e86e0bfd6d18050999520.slice/crio-973f9d4aafd6103d7061cf75606bd8609878e3f7d92cafbc86e611310e33ebb8 WatchSource:0}: Error finding container 973f9d4aafd6103d7061cf75606bd8609878e3f7d92cafbc86e611310e33ebb8: Status 404 returned error can't find the container with id 973f9d4aafd6103d7061cf75606bd8609878e3f7d92cafbc86e611310e33ebb8 Jun 09 11:55:16.468255 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:16.468238 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f0d4a1077d563d52f313d9821fb5af.slice/crio-51e32e13ddcde5081d821bc9d4d75f8579762c01a3c7f9f994d19e30630d219b WatchSource:0}: Error finding container 51e32e13ddcde5081d821bc9d4d75f8579762c01a3c7f9f994d19e30630d219b: Status 404 returned error can't find the container with id 51e32e13ddcde5081d821bc9d4d75f8579762c01a3c7f9f994d19e30630d219b Jun 09 11:55:16.476088 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.476072 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:55:16.496516 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:16.496497 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:16.506084 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.506042 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 11:50:15 +0000 UTC" deadline="2028-01-23 04:42:24.542092025 +0000 UTC" Jun 09 11:55:16.506084 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.506080 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14224h47m8.036014483s" Jun 09 11:55:16.564963 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.564868 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" event={"ID":"5da38127d24e86e0bfd6d18050999520","Type":"ContainerStarted","Data":"973f9d4aafd6103d7061cf75606bd8609878e3f7d92cafbc86e611310e33ebb8"} Jun 09 11:55:16.565843 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.565808 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" event={"ID":"f8f0d4a1077d563d52f313d9821fb5af","Type":"ContainerStarted","Data":"51e32e13ddcde5081d821bc9d4d75f8579762c01a3c7f9f994d19e30630d219b"} Jun 09 11:55:16.597241 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:16.597221 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:16.697659 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:16.697628 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:16.756178 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.756149 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:16.775245 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.775215 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:16.798367 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:16.798340 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jun 09 11:55:16.872997 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.872926 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:16.891499 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.891470 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jun 09 11:55:16.903655 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.903545 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:55:16.904834 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.904620 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jun 09 11:55:16.914714 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:16.914613 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:55:17.473012 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.472981 2562 apiserver.go:52] "Watching apiserver" Jun 09 11:55:17.481276 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.481253 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 11:55:17.482404 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.482376 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-gdfnj","openshift-multus/network-metrics-daemon-grwg5","openshift-network-diagnostics/network-check-target-29ctw","openshift-network-operator/iptables-alerter-g428q","kube-system/konnectivity-agent-mflnv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg","openshift-dns/node-resolver-pb7fh","openshift-image-registry/node-ca-fd8t9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-kghvx","kube-system/global-pull-secret-syncer-rgt2r","kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal","openshift-cluster-node-tuning-operator/tuned-j6bn5","openshift-multus/multus-additional-cni-plugins-h6gjb"] Jun 09 11:55:17.483741 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.483719 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.484921 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.484901 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.486113 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.486095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:17.486231 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.486178 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:17.486231 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.486211 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 11:55:17.486536 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.486517 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mcsvb\"" Jun 09 11:55:17.486632 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.486567 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 11:55:17.487236 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.487217 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 11:55:17.487236 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.487233 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:55:17.487422 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.487306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.488286 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.488112 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-89hq8\"" Jun 09 11:55:17.488572 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.488557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:17.489539 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.489515 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:55:17.489667 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.489535 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 11:55:17.489859 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.489842 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vqqgm\"" Jun 09 11:55:17.490145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.490119 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 11:55:17.491629 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.491611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.491729 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.491701 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 11:55:17.492282 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.492163 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-78p8s\"" Jun 09 11:55:17.492878 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.492419 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 11:55:17.492992 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.492936 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 11:55:17.492992 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.492958 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.495389 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.495372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.496500 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.496480 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 11:55:17.496589 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.496563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:17.496662 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.496637 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:17.496722 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.496668 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 11:55:17.497209 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497192 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 11:55:17.497296 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497231 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 11:55:17.497360 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497301 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8mzfd\"" Jun 09 11:55:17.497447 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497433 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 11:55:17.497568 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497548 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2jt7x\"" Jun 09 11:55:17.497568 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497470 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 11:55:17.497710 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497485 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 11:55:17.497710 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 11:55:17.497806 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497771 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zvfqq\"" Jun 09 11:55:17.497879 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.497831 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 11:55:17.498335 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.498316 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.500006 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.499987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:17.500109 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.500069 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:17.500780 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.500578 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 11:55:17.500780 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.500640 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 11:55:17.500780 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.500667 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 11:55:17.500780 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.500778 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k7wwn\"" Jun 09 11:55:17.501049 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.500860 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 11:55:17.501049 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.500919 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 11:55:17.501049 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.500945 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 11:55:17.501584 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.501568 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.503197 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503177 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-os-release\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.503291 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/363c33d6-6510-4dc4-b6a4-b4c3b600bdb9-hosts-file\") pod \"node-resolver-pb7fh\" (UID: \"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9\") " pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.503291 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363c33d6-6510-4dc4-b6a4-b4c3b600bdb9-tmp-dir\") pod \"node-resolver-pb7fh\" (UID: \"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9\") " pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.503291 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfxs8\" (UniqueName: \"kubernetes.io/projected/363c33d6-6510-4dc4-b6a4-b4c3b600bdb9-kube-api-access-gfxs8\") pod \"node-resolver-pb7fh\" (UID: \"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9\") " pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.503445 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d87f5ae9-925c-48ef-a9d2-d844c0b11f43-host-slash\") pod \"iptables-alerter-g428q\" (UID: \"d87f5ae9-925c-48ef-a9d2-d844c0b11f43\") " pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.503445 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503327 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-os-release\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.503445 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.503445 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-system-cni-dir\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.503445 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-sysconfig\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.503445 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-cnibin\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-var-lib-kubelet\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-hostroot\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-modprobe-d\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-kubernetes\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np4kf\" (UniqueName: \"kubernetes.io/projected/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-kube-api-access-np4kf\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503601 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-daemon-config\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503654 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503670 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lzw46\"" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503673 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 11:55:17.503732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503671 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-sysctl-conf\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-lib-modules\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-cnibin\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7lxd\" (UniqueName: \"kubernetes.io/projected/805e8c6d-566e-4175-a51d-de4d22b36c33-kube-api-access-f7lxd\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78dmh\" (UniqueName: \"kubernetes.io/projected/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-kube-api-access-78dmh\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-tmp\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503949 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.503989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-systemd\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-conf-dir\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-device-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-run\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504116 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-run-netns\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-socket-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-sys\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.504249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-socket-dir-parent\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-run-k8s-cni-cncf-io\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d87f5ae9-925c-48ef-a9d2-d844c0b11f43-iptables-alerter-script\") pod \"iptables-alerter-g428q\" (UID: \"d87f5ae9-925c-48ef-a9d2-d844c0b11f43\") " pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-host\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504305 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-tuned\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-run-multus-certs\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw98k\" (UniqueName: \"kubernetes.io/projected/d87f5ae9-925c-48ef-a9d2-d844c0b11f43-kube-api-access-sw98k\") pod \"iptables-alerter-g428q\" (UID: \"d87f5ae9-925c-48ef-a9d2-d844c0b11f43\") " pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-registration-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/805e8c6d-566e-4175-a51d-de4d22b36c33-cni-binary-copy\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-var-lib-cni-bin\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-etc-kubernetes\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-sys-fs\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-system-cni-dir\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504577 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-sysctl-d\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504599 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-cni-dir\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.504970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:17.505614 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-var-lib-kubelet\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.505614 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504666 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkn7j\" (UniqueName: \"kubernetes.io/projected/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-kube-api-access-dkn7j\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.505614 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a6f2c58-ed1b-420a-93b0-37296567aab5-konnectivity-ca\") pod \"konnectivity-agent-mflnv\" (UID: \"9a6f2c58-ed1b-420a-93b0-37296567aab5\") " pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:17.505614 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-var-lib-cni-multus\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.505614 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.504751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a6f2c58-ed1b-420a-93b0-37296567aab5-agent-certs\") pod \"konnectivity-agent-mflnv\" (UID: \"9a6f2c58-ed1b-420a-93b0-37296567aab5\") " pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:17.507097 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.507076 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:55:17.536333 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.536308 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kbq6v" Jun 09 11:55:17.545327 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.545298 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kbq6v" Jun 09 11:55:17.592546 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.592479 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 11:55:17.605210 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a6f2c58-ed1b-420a-93b0-37296567aab5-agent-certs\") pod \"konnectivity-agent-mflnv\" (UID: \"9a6f2c58-ed1b-420a-93b0-37296567aab5\") " pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:17.605361 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-run-ovn\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.605361 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-node-log\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.605361 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-env-overrides\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.605516 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-log-socket\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.605516 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-os-release\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.605516 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/363c33d6-6510-4dc4-b6a4-b4c3b600bdb9-hosts-file\") pod \"node-resolver-pb7fh\" (UID: \"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9\") " pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.605516 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363c33d6-6510-4dc4-b6a4-b4c3b600bdb9-tmp-dir\") pod \"node-resolver-pb7fh\" (UID: \"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9\") " pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.605516 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfxs8\" (UniqueName: \"kubernetes.io/projected/363c33d6-6510-4dc4-b6a4-b4c3b600bdb9-kube-api-access-gfxs8\") pod \"node-resolver-pb7fh\" (UID: \"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9\") " pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.605737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d87f5ae9-925c-48ef-a9d2-d844c0b11f43-host-slash\") pod \"iptables-alerter-g428q\" (UID: \"d87f5ae9-925c-48ef-a9d2-d844c0b11f43\") " pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.605737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-os-release\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.605737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d87f5ae9-925c-48ef-a9d2-d844c0b11f43-host-slash\") pod \"iptables-alerter-g428q\" (UID: \"d87f5ae9-925c-48ef-a9d2-d844c0b11f43\") " pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.605737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:17.605737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.605737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/363c33d6-6510-4dc4-b6a4-b4c3b600bdb9-hosts-file\") pod \"node-resolver-pb7fh\" (UID: \"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9\") " pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.605737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.605737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-os-release\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.605737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605637 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-system-cni-dir\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605790 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363c33d6-6510-4dc4-b6a4-b4c3b600bdb9-tmp-dir\") pod \"node-resolver-pb7fh\" (UID: \"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9\") " pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-os-release\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-system-cni-dir\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-sysconfig\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-slash\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-cni-netd\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-cnibin\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-sysconfig\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.605994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-var-lib-kubelet\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-hostroot\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-modprobe-d\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-cnibin\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-kubernetes\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-var-lib-kubelet\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-kubernetes\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.606171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-hostroot\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np4kf\" (UniqueName: \"kubernetes.io/projected/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-kube-api-access-np4kf\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-run-openvswitch\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606189 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-modprobe-d\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-ovnkube-config\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-daemon-config\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606308 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-sysctl-conf\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-lib-modules\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-cnibin\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-systemd-units\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-sysctl-conf\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606378 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-288rv\" (UniqueName: \"kubernetes.io/projected/1d1e36e7-7f10-4b1b-970f-2253327f8836-kube-api-access-288rv\") pod \"node-ca-fd8t9\" (UID: \"1d1e36e7-7f10-4b1b-970f-2253327f8836\") " pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606450 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-cnibin\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.606943 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7lxd\" (UniqueName: \"kubernetes.io/projected/805e8c6d-566e-4175-a51d-de4d22b36c33-kube-api-access-f7lxd\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dmh\" (UniqueName: \"kubernetes.io/projected/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-kube-api-access-78dmh\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606517 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-lib-modules\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606528 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-tmp\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-kubelet\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-run-netns\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-ovnkube-script-lib\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d1e36e7-7f10-4b1b-970f-2253327f8836-host\") pod \"node-ca-fd8t9\" (UID: \"1d1e36e7-7f10-4b1b-970f-2253327f8836\") " pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606795 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-systemd\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-run-systemd\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606927 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606956 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-systemd\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.606991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-conf-dir\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-device-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.607754 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-run\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-conf-dir\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/377b75bb-6ace-4ed4-93fd-0489635ff132-kubelet-config\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-run-netns\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-device-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-socket-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-sys\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-run\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjqjt\" (UniqueName: \"kubernetes.io/projected/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-kube-api-access-jjqjt\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607166 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-run-netns\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-var-lib-openvswitch\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607264 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-daemon-config\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-socket-dir-parent\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-sys\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-run-k8s-cni-cncf-io\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d87f5ae9-925c-48ef-a9d2-d844c0b11f43-iptables-alerter-script\") pod \"iptables-alerter-g428q\" (UID: \"d87f5ae9-925c-48ef-a9d2-d844c0b11f43\") " pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607340 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-socket-dir-parent\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.608611 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-socket-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607356 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607371 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-run-k8s-cni-cncf-io\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-host\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-tuned\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/377b75bb-6ace-4ed4-93fd-0489635ff132-dbus\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607464 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-host\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-run-multus-certs\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw98k\" (UniqueName: \"kubernetes.io/projected/d87f5ae9-925c-48ef-a9d2-d844c0b11f43-kube-api-access-sw98k\") pod \"iptables-alerter-g428q\" (UID: \"d87f5ae9-925c-48ef-a9d2-d844c0b11f43\") " pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607518 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-run-multus-certs\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-registration-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxm78\" (UniqueName: \"kubernetes.io/projected/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-kube-api-access-bxm78\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607586 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d1e36e7-7f10-4b1b-970f-2253327f8836-serviceca\") pod \"node-ca-fd8t9\" (UID: \"1d1e36e7-7f10-4b1b-970f-2253327f8836\") " pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/805e8c6d-566e-4175-a51d-de4d22b36c33-cni-binary-copy\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607626 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-registration-dir\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.609242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-var-lib-cni-bin\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-var-lib-cni-bin\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-etc-kubernetes\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607732 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-etc-kubernetes\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-sys-fs\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-system-cni-dir\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607795 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-sys-fs\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-sysctl-d\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-etc-openvswitch\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607850 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-system-cni-dir\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-cni-bin\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d87f5ae9-925c-48ef-a9d2-d844c0b11f43-iptables-alerter-script\") pod \"iptables-alerter-g428q\" (UID: \"d87f5ae9-925c-48ef-a9d2-d844c0b11f43\") " pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607916 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-sysctl-d\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-cni-dir\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.607979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-var-lib-kubelet\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.609910 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkn7j\" (UniqueName: \"kubernetes.io/projected/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-kube-api-access-dkn7j\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a6f2c58-ed1b-420a-93b0-37296567aab5-konnectivity-ca\") pod \"konnectivity-agent-mflnv\" (UID: \"9a6f2c58-ed1b-420a-93b0-37296567aab5\") " pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-multus-cni-dir\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-ovn-node-metrics-cert\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-var-lib-cni-multus\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/805e8c6d-566e-4175-a51d-de4d22b36c33-cni-binary-copy\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-var-lib-kubelet\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/805e8c6d-566e-4175-a51d-de4d22b36c33-host-var-lib-cni-multus\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.608583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a6f2c58-ed1b-420a-93b0-37296567aab5-konnectivity-ca\") pod \"konnectivity-agent-mflnv\" (UID: \"9a6f2c58-ed1b-420a-93b0-37296567aab5\") " pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.610423 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-etc-tuned\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.610612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.610455 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-tmp\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.611057 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.610862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a6f2c58-ed1b-420a-93b0-37296567aab5-agent-certs\") pod \"konnectivity-agent-mflnv\" (UID: \"9a6f2c58-ed1b-420a-93b0-37296567aab5\") " pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:17.615945 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.615608 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:17.615945 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.615632 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:17.615945 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.615646 2562 projected.go:196] Error preparing data for projected volume kube-api-access-k8krq for pod openshift-network-diagnostics/network-check-target-29ctw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:17.615945 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.615738 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq podName:576579e6-392a-4698-b07c-7b8f3d8d4246 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:18.115719028 +0000 UTC m=+2.987981994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k8krq" (UniqueName: "kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq") pod "network-check-target-29ctw" (UID: "576579e6-392a-4698-b07c-7b8f3d8d4246") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:17.615945 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.615751 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np4kf\" (UniqueName: \"kubernetes.io/projected/fbff7d92-6bc3-4703-b53e-1567ba0c77c1-kube-api-access-np4kf\") pod \"multus-additional-cni-plugins-h6gjb\" (UID: \"fbff7d92-6bc3-4703-b53e-1567ba0c77c1\") " pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.616276 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.615957 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7lxd\" (UniqueName: \"kubernetes.io/projected/805e8c6d-566e-4175-a51d-de4d22b36c33-kube-api-access-f7lxd\") pod \"multus-gdfnj\" (UID: \"805e8c6d-566e-4175-a51d-de4d22b36c33\") " pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.617191 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.617169 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78dmh\" (UniqueName: \"kubernetes.io/projected/1b3c0be8-62c3-4f43-99f5-8d57df1e05a2-kube-api-access-78dmh\") pod \"aws-ebs-csi-driver-node-8x4qg\" (UID: \"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.617908 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.617886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw98k\" (UniqueName: \"kubernetes.io/projected/d87f5ae9-925c-48ef-a9d2-d844c0b11f43-kube-api-access-sw98k\") pod \"iptables-alerter-g428q\" (UID: \"d87f5ae9-925c-48ef-a9d2-d844c0b11f43\") " pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.618207 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.618190 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfxs8\" (UniqueName: \"kubernetes.io/projected/363c33d6-6510-4dc4-b6a4-b4c3b600bdb9-kube-api-access-gfxs8\") pod \"node-resolver-pb7fh\" (UID: \"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9\") " pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.618275 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.618229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkn7j\" (UniqueName: \"kubernetes.io/projected/6b137c6d-c6fb-42c8-9136-4e8a830a6e5d-kube-api-access-dkn7j\") pod \"tuned-j6bn5\" (UID: \"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.708725 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-kubelet\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.708725 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-run-netns\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.708953 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-ovnkube-script-lib\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.708953 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d1e36e7-7f10-4b1b-970f-2253327f8836-host\") pod \"node-ca-fd8t9\" (UID: \"1d1e36e7-7f10-4b1b-970f-2253327f8836\") " pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.708953 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-run-systemd\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.708953 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-run-netns\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.708953 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/377b75bb-6ace-4ed4-93fd-0489635ff132-kubelet-config\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:17.708953 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-run-systemd\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.708953 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-kubelet\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.708953 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqjt\" (UniqueName: \"kubernetes.io/projected/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-kube-api-access-jjqjt\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:17.708953 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-var-lib-openvswitch\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708961 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/377b75bb-6ace-4ed4-93fd-0489635ff132-dbus\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxm78\" (UniqueName: \"kubernetes.io/projected/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-kube-api-access-bxm78\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d1e36e7-7f10-4b1b-970f-2253327f8836-serviceca\") pod \"node-ca-fd8t9\" (UID: \"1d1e36e7-7f10-4b1b-970f-2253327f8836\") " pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.708862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d1e36e7-7f10-4b1b-970f-2253327f8836-host\") pod \"node-ca-fd8t9\" (UID: \"1d1e36e7-7f10-4b1b-970f-2253327f8836\") " pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709008 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/377b75bb-6ace-4ed4-93fd-0489635ff132-kubelet-config\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-etc-openvswitch\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-cni-bin\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-cni-bin\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/377b75bb-6ace-4ed4-93fd-0489635ff132-dbus\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-etc-openvswitch\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709211 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-var-lib-openvswitch\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.709241 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.709309 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret podName:377b75bb-6ace-4ed4-93fd-0489635ff132 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:18.209293613 +0000 UTC m=+3.081556580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret") pod "global-pull-secret-syncer-rgt2r" (UID: "377b75bb-6ace-4ed4-93fd-0489635ff132") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-ovn-node-metrics-cert\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.709366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-run-ovn\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.709975 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-ovnkube-script-lib\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710132 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709745 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d1e36e7-7f10-4b1b-970f-2253327f8836-serviceca\") pod \"node-ca-fd8t9\" (UID: \"1d1e36e7-7f10-4b1b-970f-2253327f8836\") " pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.710132 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-node-log\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710302 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-run-ovn\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710302 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.709369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-node-log\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710302 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710281 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-env-overrides\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710443 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-log-socket\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710443 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:17.710443 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710384 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710443 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710443 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-slash\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710679 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-cni-netd\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710679 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-run-openvswitch\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710679 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-ovnkube-config\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710679 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-systemd-units\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710679 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-288rv\" (UniqueName: \"kubernetes.io/projected/1d1e36e7-7f10-4b1b-970f-2253327f8836-kube-api-access-288rv\") pod \"node-ca-fd8t9\" (UID: \"1d1e36e7-7f10-4b1b-970f-2253327f8836\") " pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.710679 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-cni-netd\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.710679 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-slash\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.711010 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-systemd-units\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.711010 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710556 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-log-socket\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.711010 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.711010 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710782 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-env-overrides\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.711010 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.711010 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.710969 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:17.711010 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.710985 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-run-openvswitch\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.711328 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:17.711028 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs podName:595f3422-e3fc-45b0-94ea-5bebf1b50d6c nodeName:}" failed. No retries permitted until 2026-06-09 11:55:18.21100496 +0000 UTC m=+3.083267942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs") pod "network-metrics-daemon-grwg5" (UID: "595f3422-e3fc-45b0-94ea-5bebf1b50d6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:17.711328 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.711316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-ovnkube-config\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.713218 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.712859 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-ovn-node-metrics-cert\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.719725 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.719692 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxm78\" (UniqueName: \"kubernetes.io/projected/e0ed1225-ca15-427d-90e3-9fc383ef3a0b-kube-api-access-bxm78\") pod \"ovnkube-node-kghvx\" (UID: \"e0ed1225-ca15-427d-90e3-9fc383ef3a0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.719882 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.719790 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjqjt\" (UniqueName: \"kubernetes.io/projected/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-kube-api-access-jjqjt\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:17.719882 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.719836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-288rv\" (UniqueName: \"kubernetes.io/projected/1d1e36e7-7f10-4b1b-970f-2253327f8836-kube-api-access-288rv\") pod \"node-ca-fd8t9\" (UID: \"1d1e36e7-7f10-4b1b-970f-2253327f8836\") " pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.796257 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.796211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pb7fh" Jun 09 11:55:17.803638 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.803617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" Jun 09 11:55:17.813539 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.813519 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g428q" Jun 09 11:55:17.819747 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.819729 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:17.825375 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.825352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" Jun 09 11:55:17.832859 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.832842 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" Jun 09 11:55:17.840512 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.840495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdfnj" Jun 09 11:55:17.847097 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.847051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:17.853502 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.853485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fd8t9" Jun 09 11:55:17.860207 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:17.860192 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:18.214548 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.214523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:18.214664 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.214555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:18.214664 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.214578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:18.214754 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:18.214672 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:18.214754 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:18.214678 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:18.214754 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:18.214694 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:18.214754 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:18.214713 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:18.214754 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:18.214724 2562 projected.go:196] Error preparing data for projected volume kube-api-access-k8krq for pod openshift-network-diagnostics/network-check-target-29ctw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:18.214754 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:18.214728 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs podName:595f3422-e3fc-45b0-94ea-5bebf1b50d6c nodeName:}" failed. No retries permitted until 2026-06-09 11:55:19.214711882 +0000 UTC m=+4.086974867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs") pod "network-metrics-daemon-grwg5" (UID: "595f3422-e3fc-45b0-94ea-5bebf1b50d6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:18.214754 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:18.214742 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret podName:377b75bb-6ace-4ed4-93fd-0489635ff132 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:19.214736145 +0000 UTC m=+4.086999112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret") pod "global-pull-secret-syncer-rgt2r" (UID: "377b75bb-6ace-4ed4-93fd-0489635ff132") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:18.215027 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:18.214760 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq podName:576579e6-392a-4698-b07c-7b8f3d8d4246 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:19.214748592 +0000 UTC m=+4.087011557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8krq" (UniqueName: "kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq") pod "network-check-target-29ctw" (UID: "576579e6-392a-4698-b07c-7b8f3d8d4246") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:18.230451 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:18.230420 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363c33d6_6510_4dc4_b6a4_b4c3b600bdb9.slice/crio-2742a1b8484717e9f38f237e34bfb703618941d6799a2b956d1520a5fcc47f5d WatchSource:0}: Error finding container 2742a1b8484717e9f38f237e34bfb703618941d6799a2b956d1520a5fcc47f5d: Status 404 returned error can't find the container with id 2742a1b8484717e9f38f237e34bfb703618941d6799a2b956d1520a5fcc47f5d Jun 09 11:55:18.231730 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:18.231698 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3c0be8_62c3_4f43_99f5_8d57df1e05a2.slice/crio-d8998ac053b779c2961535434fa19b193a215149d72362a10a9f854ef4c56295 WatchSource:0}: Error finding container d8998ac053b779c2961535434fa19b193a215149d72362a10a9f854ef4c56295: Status 404 returned error can't find the container with id d8998ac053b779c2961535434fa19b193a215149d72362a10a9f854ef4c56295 Jun 09 11:55:18.233046 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:18.232824 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b137c6d_c6fb_42c8_9136_4e8a830a6e5d.slice/crio-a4b01b98ecaa80241a1e330f856c3c2d486cf56815591b9a1e062084cc56679d WatchSource:0}: Error finding container a4b01b98ecaa80241a1e330f856c3c2d486cf56815591b9a1e062084cc56679d: Status 404 returned error can't find the container with id a4b01b98ecaa80241a1e330f856c3c2d486cf56815591b9a1e062084cc56679d Jun 09 11:55:18.239630 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:18.239612 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1e36e7_7f10_4b1b_970f_2253327f8836.slice/crio-b862ac7ae5da7ed583e9ba4a3828d58e2eb35a398d4d50b66e918035410db966 WatchSource:0}: Error finding container b862ac7ae5da7ed583e9ba4a3828d58e2eb35a398d4d50b66e918035410db966: Status 404 returned error can't find the container with id b862ac7ae5da7ed583e9ba4a3828d58e2eb35a398d4d50b66e918035410db966 Jun 09 11:55:18.241072 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:18.241039 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87f5ae9_925c_48ef_a9d2_d844c0b11f43.slice/crio-2155b8506bcefc5bf0df62740554ae743f15fed96d3220482c7c23276b2fad7c WatchSource:0}: Error finding container 2155b8506bcefc5bf0df62740554ae743f15fed96d3220482c7c23276b2fad7c: Status 404 returned error can't find the container with id 2155b8506bcefc5bf0df62740554ae743f15fed96d3220482c7c23276b2fad7c Jun 09 11:55:18.242481 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:18.242461 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805e8c6d_566e_4175_a51d_de4d22b36c33.slice/crio-cda4ae7706bbf7fa8468bffda280774a2c57974a48c005b6f822279db9ec67fa WatchSource:0}: Error finding container cda4ae7706bbf7fa8468bffda280774a2c57974a48c005b6f822279db9ec67fa: Status 404 returned error can't find the container with id cda4ae7706bbf7fa8468bffda280774a2c57974a48c005b6f822279db9ec67fa Jun 09 11:55:18.243970 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:18.243914 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ed1225_ca15_427d_90e3_9fc383ef3a0b.slice/crio-c6e1ef5ed596ca10d145f132b72fb22fa202c1e72d067cd6592d11eaee25910d WatchSource:0}: Error finding container c6e1ef5ed596ca10d145f132b72fb22fa202c1e72d067cd6592d11eaee25910d: Status 404 returned error can't find the container with id c6e1ef5ed596ca10d145f132b72fb22fa202c1e72d067cd6592d11eaee25910d Jun 09 11:55:18.245366 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:18.245333 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6f2c58_ed1b_420a_93b0_37296567aab5.slice/crio-2a1e39cf62772360bdfcbb0a4f6085e623b396d15e9d6bdd856e09c197b11e18 WatchSource:0}: Error finding container 2a1e39cf62772360bdfcbb0a4f6085e623b396d15e9d6bdd856e09c197b11e18: Status 404 returned error can't find the container with id 2a1e39cf62772360bdfcbb0a4f6085e623b396d15e9d6bdd856e09c197b11e18 Jun 09 11:55:18.245984 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:18.245966 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbff7d92_6bc3_4703_b53e_1567ba0c77c1.slice/crio-459554fdc508231153c3fedb98b8e3f53201cf8383ae2e5d58d83baba2e9eb5c WatchSource:0}: Error finding container 459554fdc508231153c3fedb98b8e3f53201cf8383ae2e5d58d83baba2e9eb5c: Status 404 returned error can't find the container with id 459554fdc508231153c3fedb98b8e3f53201cf8383ae2e5d58d83baba2e9eb5c Jun 09 11:55:18.548259 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.548197 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:50:17 +0000 UTC" deadline="2028-01-05 21:26:31.044994091 +0000 UTC" Jun 09 11:55:18.548259 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.548254 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13809h31m12.496742333s" Jun 09 11:55:18.562566 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.562541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:18.562701 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:18.562677 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:18.569917 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.569889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" event={"ID":"e0ed1225-ca15-427d-90e3-9fc383ef3a0b","Type":"ContainerStarted","Data":"c6e1ef5ed596ca10d145f132b72fb22fa202c1e72d067cd6592d11eaee25910d"} Jun 09 11:55:18.570866 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.570841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g428q" event={"ID":"d87f5ae9-925c-48ef-a9d2-d844c0b11f43","Type":"ContainerStarted","Data":"2155b8506bcefc5bf0df62740554ae743f15fed96d3220482c7c23276b2fad7c"} Jun 09 11:55:18.571972 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.571950 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fd8t9" event={"ID":"1d1e36e7-7f10-4b1b-970f-2253327f8836","Type":"ContainerStarted","Data":"b862ac7ae5da7ed583e9ba4a3828d58e2eb35a398d4d50b66e918035410db966"} Jun 09 11:55:18.573972 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.573858 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" event={"ID":"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d","Type":"ContainerStarted","Data":"a4b01b98ecaa80241a1e330f856c3c2d486cf56815591b9a1e062084cc56679d"} Jun 09 11:55:18.576935 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.576910 2562 generic.go:356] "Generic (PLEG): container finished" podID="f8f0d4a1077d563d52f313d9821fb5af" containerID="57413150109e9304ccb155a4b4aa513d9d77f11d63772487a5a3adb0467c38d3" exitCode=0 Jun 09 11:55:18.577031 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.576946 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" event={"ID":"f8f0d4a1077d563d52f313d9821fb5af","Type":"ContainerDied","Data":"57413150109e9304ccb155a4b4aa513d9d77f11d63772487a5a3adb0467c38d3"} Jun 09 11:55:18.578301 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.578276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" event={"ID":"fbff7d92-6bc3-4703-b53e-1567ba0c77c1","Type":"ContainerStarted","Data":"459554fdc508231153c3fedb98b8e3f53201cf8383ae2e5d58d83baba2e9eb5c"} Jun 09 11:55:18.579545 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.579523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mflnv" event={"ID":"9a6f2c58-ed1b-420a-93b0-37296567aab5","Type":"ContainerStarted","Data":"2a1e39cf62772360bdfcbb0a4f6085e623b396d15e9d6bdd856e09c197b11e18"} Jun 09 11:55:18.581006 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.580984 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdfnj" event={"ID":"805e8c6d-566e-4175-a51d-de4d22b36c33","Type":"ContainerStarted","Data":"cda4ae7706bbf7fa8468bffda280774a2c57974a48c005b6f822279db9ec67fa"} Jun 09 11:55:18.582225 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.582192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" event={"ID":"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2","Type":"ContainerStarted","Data":"d8998ac053b779c2961535434fa19b193a215149d72362a10a9f854ef4c56295"} Jun 09 11:55:18.583678 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.583560 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pb7fh" event={"ID":"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9","Type":"ContainerStarted","Data":"2742a1b8484717e9f38f237e34bfb703618941d6799a2b956d1520a5fcc47f5d"} Jun 09 11:55:18.585223 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.585196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" event={"ID":"5da38127d24e86e0bfd6d18050999520","Type":"ContainerStarted","Data":"4b84815653e8ff41362e3cb7e8f747ba5455a3f408633c03da1f5f6385d76496"} Jun 09 11:55:18.607291 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:18.607239 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" podStartSLOduration=2.607220395 podStartE2EDuration="2.607220395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:18.60613279 +0000 UTC m=+3.478395778" watchObservedRunningTime="2026-06-09 11:55:18.607220395 +0000 UTC m=+3.479483384" Jun 09 11:55:19.224314 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:19.223986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:19.224314 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:19.224053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:19.224314 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:19.224093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:19.224314 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.224255 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:19.224314 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.224318 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs podName:595f3422-e3fc-45b0-94ea-5bebf1b50d6c nodeName:}" failed. No retries permitted until 2026-06-09 11:55:21.224299418 +0000 UTC m=+6.096562406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs") pod "network-metrics-daemon-grwg5" (UID: "595f3422-e3fc-45b0-94ea-5bebf1b50d6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:19.224754 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.224730 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:19.224842 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.224783 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret podName:377b75bb-6ace-4ed4-93fd-0489635ff132 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:21.224767839 +0000 UTC m=+6.097030808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret") pod "global-pull-secret-syncer-rgt2r" (UID: "377b75bb-6ace-4ed4-93fd-0489635ff132") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:19.224906 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.224884 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:19.224906 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.224899 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:19.225002 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.224911 2562 projected.go:196] Error preparing data for projected volume kube-api-access-k8krq for pod openshift-network-diagnostics/network-check-target-29ctw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:19.225002 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.224946 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq podName:576579e6-392a-4698-b07c-7b8f3d8d4246 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:21.224935156 +0000 UTC m=+6.097198126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8krq" (UniqueName: "kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq") pod "network-check-target-29ctw" (UID: "576579e6-392a-4698-b07c-7b8f3d8d4246") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:19.549533 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:19.549365 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:50:17 +0000 UTC" deadline="2028-02-29 17:13:16.25284744 +0000 UTC" Jun 09 11:55:19.549533 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:19.549426 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15125h17m56.703425772s" Jun 09 11:55:19.582020 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:19.581076 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:19.582020 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.581190 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:19.582020 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:19.581602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:19.582020 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:19.581694 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:19.616853 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:19.616412 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" event={"ID":"f8f0d4a1077d563d52f313d9821fb5af","Type":"ContainerStarted","Data":"ca7f92a4cdc6e0928409dbc0c69f74a572db1768a3d312312589388f449aeac7"} Jun 09 11:55:20.562059 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:20.562010 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:20.562561 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:20.562143 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:21.242742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:21.242793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:21.242845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.242982 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.243045 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs podName:595f3422-e3fc-45b0-94ea-5bebf1b50d6c nodeName:}" failed. No retries permitted until 2026-06-09 11:55:25.243026789 +0000 UTC m=+10.115289758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs") pod "network-metrics-daemon-grwg5" (UID: "595f3422-e3fc-45b0-94ea-5bebf1b50d6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.243112 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.243147 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret podName:377b75bb-6ace-4ed4-93fd-0489635ff132 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:25.243135969 +0000 UTC m=+10.115398941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret") pod "global-pull-secret-syncer-rgt2r" (UID: "377b75bb-6ace-4ed4-93fd-0489635ff132") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.243232 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.243249 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.243262 2562 projected.go:196] Error preparing data for projected volume kube-api-access-k8krq for pod openshift-network-diagnostics/network-check-target-29ctw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:21.243653 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.243298 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq podName:576579e6-392a-4698-b07c-7b8f3d8d4246 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:25.243286308 +0000 UTC m=+10.115549287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8krq" (UniqueName: "kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq") pod "network-check-target-29ctw" (UID: "576579e6-392a-4698-b07c-7b8f3d8d4246") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:21.565889 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:21.565493 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:21.565889 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.565621 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:21.566612 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:21.566468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:21.566612 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:21.566566 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:22.562616 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:22.562583 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:22.562798 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:22.562727 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:23.566275 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:23.566236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:23.566722 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:23.566367 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:23.566722 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:23.566236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:23.566722 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:23.566507 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:24.561887 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:24.561855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:24.562075 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:24.562002 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:25.273994 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:25.273247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:25.273994 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:25.273297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:25.273994 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:25.273338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:25.273994 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.273580 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:25.273994 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.273635 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:25.273994 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.273652 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret podName:377b75bb-6ace-4ed4-93fd-0489635ff132 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:33.273632891 +0000 UTC m=+18.145895863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret") pod "global-pull-secret-syncer-rgt2r" (UID: "377b75bb-6ace-4ed4-93fd-0489635ff132") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:25.273994 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.273660 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:25.273994 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.273676 2562 projected.go:196] Error preparing data for projected volume kube-api-access-k8krq for pod openshift-network-diagnostics/network-check-target-29ctw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:25.273994 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.273727 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq podName:576579e6-392a-4698-b07c-7b8f3d8d4246 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:33.273712046 +0000 UTC m=+18.145975028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8krq" (UniqueName: "kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq") pod "network-check-target-29ctw" (UID: "576579e6-392a-4698-b07c-7b8f3d8d4246") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:25.275025 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.274106 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:25.275025 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.274168 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs podName:595f3422-e3fc-45b0-94ea-5bebf1b50d6c nodeName:}" failed. No retries permitted until 2026-06-09 11:55:33.274151289 +0000 UTC m=+18.146414268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs") pod "network-metrics-daemon-grwg5" (UID: "595f3422-e3fc-45b0-94ea-5bebf1b50d6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:25.564922 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:25.562642 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:25.564922 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.562756 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:25.564922 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:25.563048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:25.564922 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:25.563141 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:26.562849 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:26.562751 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:26.563389 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:26.562912 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:27.562352 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:27.562312 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:27.562532 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:27.562312 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:27.562532 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:27.562446 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:27.562532 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:27.562506 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:28.562553 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:28.562513 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:28.562922 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:28.562634 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:29.562362 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:29.562324 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:29.562538 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:29.562333 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:29.562538 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:29.562460 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:29.562931 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:29.562531 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:30.562229 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:30.562200 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:30.562386 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:30.562324 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:31.561937 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:31.561900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:31.562388 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:31.561911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:31.562388 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:31.562015 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:31.562388 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:31.562105 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:32.562468 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:32.562391 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:32.562907 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:32.562509 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:33.335060 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:33.335026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:33.335243 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:33.335068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:33.335243 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:33.335185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:33.335243 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.335187 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:33.335394 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.335263 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:33.335394 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.335286 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:33.335394 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.335300 2562 projected.go:196] Error preparing data for projected volume kube-api-access-k8krq for pod openshift-network-diagnostics/network-check-target-29ctw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:33.335394 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.335300 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret podName:377b75bb-6ace-4ed4-93fd-0489635ff132 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:49.335280116 +0000 UTC m=+34.207543104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret") pod "global-pull-secret-syncer-rgt2r" (UID: "377b75bb-6ace-4ed4-93fd-0489635ff132") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:33.335394 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.335300 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:33.335394 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.335338 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs podName:595f3422-e3fc-45b0-94ea-5bebf1b50d6c nodeName:}" failed. No retries permitted until 2026-06-09 11:55:49.335328445 +0000 UTC m=+34.207591411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs") pod "network-metrics-daemon-grwg5" (UID: "595f3422-e3fc-45b0-94ea-5bebf1b50d6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:33.335394 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.335357 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq podName:576579e6-392a-4698-b07c-7b8f3d8d4246 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:49.335348646 +0000 UTC m=+34.207611618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8krq" (UniqueName: "kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq") pod "network-check-target-29ctw" (UID: "576579e6-392a-4698-b07c-7b8f3d8d4246") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:33.562560 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:33.562516 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:33.562560 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:33.562562 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:33.562981 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.562647 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:33.562981 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:33.562756 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:34.562593 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:34.562555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:34.563064 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:34.562681 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:35.563058 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:35.563027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:35.563454 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:35.563143 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:35.563454 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:35.563216 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:35.563454 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:35.563335 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:36.562652 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:36.562617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:36.562802 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:36.562742 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:37.562871 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.562584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:37.562871 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.562584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:37.563421 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:37.562890 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:37.563421 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:37.562933 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:37.656571 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.656539 2562 generic.go:356] "Generic (PLEG): container finished" podID="fbff7d92-6bc3-4703-b53e-1567ba0c77c1" containerID="ab7d35c3225092fe7ee2e4195aa327744acc3bf0d1386c98b8f7c00516163331" exitCode=0 Jun 09 11:55:37.656710 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.656619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" event={"ID":"fbff7d92-6bc3-4703-b53e-1567ba0c77c1","Type":"ContainerDied","Data":"ab7d35c3225092fe7ee2e4195aa327744acc3bf0d1386c98b8f7c00516163331"} Jun 09 11:55:37.658022 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.657936 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mflnv" event={"ID":"9a6f2c58-ed1b-420a-93b0-37296567aab5","Type":"ContainerStarted","Data":"64d2e975e40c2d2361437c3d2a704c4c57de308ec53a8351dea78c22d80a7e8e"} Jun 09 11:55:37.659389 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.659365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdfnj" event={"ID":"805e8c6d-566e-4175-a51d-de4d22b36c33","Type":"ContainerStarted","Data":"6733039eab1b7b5ff69e9f3f3a0122bcd442fb93bf9f3ed78bb85594f6c6f4bb"} Jun 09 11:55:37.660896 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.660874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" event={"ID":"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2","Type":"ContainerStarted","Data":"4ff2986365818498fa8e42f8728b0367c8e625ebe6b387c05244aaff216dbae2"} Jun 09 11:55:37.662115 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.662096 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pb7fh" event={"ID":"363c33d6-6510-4dc4-b6a4-b4c3b600bdb9","Type":"ContainerStarted","Data":"327420bc0ed1ed02c217fd3dbbfda37130341bf5a369097bdc5bd86e0928138e"} Jun 09 11:55:37.664361 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.664333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" event={"ID":"e0ed1225-ca15-427d-90e3-9fc383ef3a0b","Type":"ContainerStarted","Data":"1e05f95c79dabc1f6aa10fd6b9c130693822a5428dc30e59af496d708c6c5f64"} Jun 09 11:55:37.664450 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.664392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" event={"ID":"e0ed1225-ca15-427d-90e3-9fc383ef3a0b","Type":"ContainerStarted","Data":"f962cf72cbf6b22a3145d0bc2c070a8cb8f81031f3847d4ac30a97979ab5419c"} Jun 09 11:55:37.664450 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.664422 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" event={"ID":"e0ed1225-ca15-427d-90e3-9fc383ef3a0b","Type":"ContainerStarted","Data":"098dd98e6102c7fa5a8d232e9c4f433a021af18f81ebdfb99ea32510791f6896"} Jun 09 11:55:37.664539 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.664450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" event={"ID":"e0ed1225-ca15-427d-90e3-9fc383ef3a0b","Type":"ContainerStarted","Data":"f9cb676b4af7d6a831383e744d51c7339751711c3a5024487d574f3aa2cb3833"} Jun 09 11:55:37.665686 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.665647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fd8t9" event={"ID":"1d1e36e7-7f10-4b1b-970f-2253327f8836","Type":"ContainerStarted","Data":"9312a2b968145c822c830a087e91f2d45f32834bcdc2ef24d6d17c6fc7ee4b73"} Jun 09 11:55:37.666934 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.666916 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" event={"ID":"6b137c6d-c6fb-42c8-9136-4e8a830a6e5d","Type":"ContainerStarted","Data":"9731e30e97998129a35158ca67090d903394a6023405e7ef4c9b787e51bf706c"} Jun 09 11:55:37.678880 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.678843 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" podStartSLOduration=21.67883321 podStartE2EDuration="21.67883321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:19.634896118 +0000 UTC m=+4.507159120" watchObservedRunningTime="2026-06-09 11:55:37.67883321 +0000 UTC m=+22.551096189" Jun 09 11:55:37.695199 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.693510 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mflnv" podStartSLOduration=8.66473304 podStartE2EDuration="22.693493513s" totalImagesPullingTime="14.028760473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:37.692664258 +0000 UTC m=+22.564927247" watchObservedRunningTime="2026-06-09 11:55:37.693493513 +0000 UTC m=+22.565756501" Jun 09 11:55:37.711217 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.711168 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gdfnj" podStartSLOduration=3.704213437 podStartE2EDuration="22.711154749s" totalImagesPullingTime="19.006941312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:37.710462831 +0000 UTC m=+22.582725815" watchObservedRunningTime="2026-06-09 11:55:37.711154749 +0000 UTC m=+22.583417751" Jun 09 11:55:37.725559 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.725503 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pb7fh" podStartSLOduration=3.8818116270000003 podStartE2EDuration="22.72548432s" totalImagesPullingTime="18.843672693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:37.724947849 +0000 UTC m=+22.597210838" watchObservedRunningTime="2026-06-09 11:55:37.72548432 +0000 UTC m=+22.597747310" Jun 09 11:55:37.745971 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:37.745924 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j6bn5" podStartSLOduration=3.904326551 podStartE2EDuration="22.745906969s" totalImagesPullingTime="18.841580418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:37.744479255 +0000 UTC m=+22.616742270" watchObservedRunningTime="2026-06-09 11:55:37.745906969 +0000 UTC m=+22.618169958" Jun 09 11:55:38.448125 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.448095 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 11:55:38.559918 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.559799 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T11:55:38.448117789Z","UUID":"45431a13-8438-49b7-a315-dfe007e17596","Handler":null,"Name":"","Endpoint":""} Jun 09 11:55:38.561208 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.561188 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 11:55:38.561333 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.561228 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 11:55:38.561931 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.561850 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:38.562084 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:38.561974 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:38.671923 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.671837 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" event={"ID":"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2","Type":"ContainerStarted","Data":"741f34f95fafab1844f8cf63fbb88fb179fe2d0a8dd5b4b32172eea92983b064"} Jun 09 11:55:38.675145 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.675113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" event={"ID":"e0ed1225-ca15-427d-90e3-9fc383ef3a0b","Type":"ContainerStarted","Data":"84c5c7e2fabfbeff2cb0f0f89f7986219d3a014994d31eb465a015924a610e0a"} Jun 09 11:55:38.675301 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.675201 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" event={"ID":"e0ed1225-ca15-427d-90e3-9fc383ef3a0b","Type":"ContainerStarted","Data":"38491818bcf2e615e0b01eaf2b4a33de7cabb166a15e6f641ccbad1dc577dc94"} Jun 09 11:55:38.677220 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.676718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g428q" event={"ID":"d87f5ae9-925c-48ef-a9d2-d844c0b11f43","Type":"ContainerStarted","Data":"1f72746f3675004ae2454a1e6cd0f09d3034be5d2b116a38491346680bb8a872"} Jun 09 11:55:38.692363 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.692319 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fd8t9" podStartSLOduration=4.857332316 podStartE2EDuration="23.692306043s" totalImagesPullingTime="18.834973727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:37.760667494 +0000 UTC m=+22.632930483" watchObservedRunningTime="2026-06-09 11:55:38.692306043 +0000 UTC m=+23.564569031" Jun 09 11:55:38.693061 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.693020 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g428q" podStartSLOduration=4.859730723 podStartE2EDuration="23.693009772s" totalImagesPullingTime="18.833279049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:38.692458489 +0000 UTC m=+23.564721471" watchObservedRunningTime="2026-06-09 11:55:38.693009772 +0000 UTC m=+23.565272761" Jun 09 11:55:38.694621 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.694598 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:38.695171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:38.695151 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:39.461016 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:39.460978 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:39.461519 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:39.461499 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mflnv" Jun 09 11:55:39.562159 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:39.562123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:39.562332 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:39.562164 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:39.562332 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:39.562276 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:39.562467 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:39.562439 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:40.562923 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:40.562725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:40.563379 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:40.563028 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:40.684171 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:40.684134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" event={"ID":"1b3c0be8-62c3-4f43-99f5-8d57df1e05a2","Type":"ContainerStarted","Data":"1d91e793edf6eeda49b1900575fa91fa6ed6e9bd3a2f1d7732e7e80679565b1e"} Jun 09 11:55:40.687833 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:40.687790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" event={"ID":"e0ed1225-ca15-427d-90e3-9fc383ef3a0b","Type":"ContainerStarted","Data":"47a847b0109b8d2fbde622a7ea1b91f3ed3eefbc443c2b4a1989f67dbb852081"} Jun 09 11:55:40.701269 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:40.701225 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x4qg" podStartSLOduration=4.722734437 podStartE2EDuration="25.701210698s" totalImagesPullingTime="20.978476261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:40.701094225 +0000 UTC m=+25.573357213" watchObservedRunningTime="2026-06-09 11:55:40.701210698 +0000 UTC m=+25.573473852" Jun 09 11:55:41.562738 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:41.562705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:41.562738 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:41.562748 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:41.563420 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:41.562889 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:41.563420 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:41.563015 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:42.562991 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:42.562717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:42.563638 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:42.563006 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:42.695132 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:42.695089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" event={"ID":"e0ed1225-ca15-427d-90e3-9fc383ef3a0b","Type":"ContainerStarted","Data":"8eca6afed2629d82c9954f29c2284b86506dadd9aea66dc7493da7b9ab3ff889"} Jun 09 11:55:42.695414 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:42.695387 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:42.695524 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:42.695464 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:42.697451 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:42.697424 2562 generic.go:356] "Generic (PLEG): container finished" podID="fbff7d92-6bc3-4703-b53e-1567ba0c77c1" containerID="1acb7aa6c481e0e6e937958871c7a18f6f626443755e7bc479d3843535705bcf" exitCode=0 Jun 09 11:55:42.697549 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:42.697470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" event={"ID":"fbff7d92-6bc3-4703-b53e-1567ba0c77c1","Type":"ContainerDied","Data":"1acb7aa6c481e0e6e937958871c7a18f6f626443755e7bc479d3843535705bcf"} Jun 09 11:55:42.712692 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:42.712670 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:42.726074 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:42.726027 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" podStartSLOduration=8.84844901 podStartE2EDuration="27.72601388s" totalImagesPullingTime="18.87756487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:42.725693429 +0000 UTC m=+27.597956420" watchObservedRunningTime="2026-06-09 11:55:42.72601388 +0000 UTC m=+27.598276868" Jun 09 11:55:43.562260 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:43.562228 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:43.562632 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:43.562328 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:43.562632 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:43.562376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:43.562632 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:43.562470 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:43.700315 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:43.700286 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:43.714753 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:43.714727 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:55:44.394555 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:44.394525 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-29ctw"] Jun 09 11:55:44.394708 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:44.394624 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:44.394759 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:44.394723 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:44.397912 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:44.397881 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-grwg5"] Jun 09 11:55:44.398038 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:44.398000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:44.398128 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:44.398109 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:44.398711 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:44.398689 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rgt2r"] Jun 09 11:55:44.398784 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:44.398772 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:44.398927 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:44.398892 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:44.704164 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:44.704134 2562 generic.go:356] "Generic (PLEG): container finished" podID="fbff7d92-6bc3-4703-b53e-1567ba0c77c1" containerID="f26238c0e1aa097b645f10764fcc4eb42245c8a92ee8e390f556492c88393b7d" exitCode=0 Jun 09 11:55:44.704540 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:44.704213 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" event={"ID":"fbff7d92-6bc3-4703-b53e-1567ba0c77c1","Type":"ContainerDied","Data":"f26238c0e1aa097b645f10764fcc4eb42245c8a92ee8e390f556492c88393b7d"} Jun 09 11:55:45.563207 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:45.563013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:45.563377 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:45.563070 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:45.563377 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:45.563287 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:45.563377 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:45.563355 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:46.562180 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:46.562095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:46.562631 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:46.562200 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:46.712366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:46.712336 2562 generic.go:356] "Generic (PLEG): container finished" podID="fbff7d92-6bc3-4703-b53e-1567ba0c77c1" containerID="f67d3c1514a0aea0f7ac842b7dfa79100185c33e6c5907518b55599fc7c8f6a8" exitCode=0 Jun 09 11:55:46.712366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:46.712376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" event={"ID":"fbff7d92-6bc3-4703-b53e-1567ba0c77c1","Type":"ContainerDied","Data":"f67d3c1514a0aea0f7ac842b7dfa79100185c33e6c5907518b55599fc7c8f6a8"} Jun 09 11:55:47.562935 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:47.562895 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:47.563554 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:47.562895 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:47.563554 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:47.563021 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:47.563554 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:47.563085 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:48.562437 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:48.562401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:48.562622 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:48.562522 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:49.355706 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:49.355662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:49.355706 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:49.355707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:49.356120 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:49.355730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:49.356120 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.355825 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:49.356120 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.355828 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:49.356120 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.355843 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:49.356120 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.355862 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:49.356120 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.355872 2562 projected.go:196] Error preparing data for projected volume kube-api-access-k8krq for pod openshift-network-diagnostics/network-check-target-29ctw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:49.356120 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.355875 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs podName:595f3422-e3fc-45b0-94ea-5bebf1b50d6c nodeName:}" failed. No retries permitted until 2026-06-09 11:56:21.355862594 +0000 UTC m=+66.228125560 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs") pod "network-metrics-daemon-grwg5" (UID: "595f3422-e3fc-45b0-94ea-5bebf1b50d6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:49.356120 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.355888 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret podName:377b75bb-6ace-4ed4-93fd-0489635ff132 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:21.355882303 +0000 UTC m=+66.228145269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret") pod "global-pull-secret-syncer-rgt2r" (UID: "377b75bb-6ace-4ed4-93fd-0489635ff132") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:49.356120 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.355906 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq podName:576579e6-392a-4698-b07c-7b8f3d8d4246 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:21.355893797 +0000 UTC m=+66.228156767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8krq" (UniqueName: "kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq") pod "network-check-target-29ctw" (UID: "576579e6-392a-4698-b07c-7b8f3d8d4246") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:49.565643 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:49.565620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:49.565773 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:49.565620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:49.565773 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.565724 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:55:49.565876 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:49.565825 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-29ctw" podUID="576579e6-392a-4698-b07c-7b8f3d8d4246" Jun 09 11:55:50.562150 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:50.562113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:50.562687 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:50.562256 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgt2r" podUID="377b75bb-6ace-4ed4-93fd-0489635ff132" Jun 09 11:55:50.953007 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:50.952975 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeReady" Jun 09 11:55:50.953183 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:50.953140 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 11:55:50.996774 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:50.996742 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-glnpb"] Jun 09 11:55:50.999989 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:50.999876 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nsdkd"] Jun 09 11:55:51.000244 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.000223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.001578 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.001559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nsdkd" Jun 09 11:55:51.002578 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.002553 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 11:55:51.002578 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.002569 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xs666\"" Jun 09 11:55:51.002738 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.002597 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 11:55:51.004358 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.004199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tpmhc\"" Jun 09 11:55:51.004358 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.004208 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 11:55:51.004358 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.004317 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 11:55:51.004358 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.004329 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 11:55:51.009362 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.009300 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-glnpb"] Jun 09 11:55:51.012716 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.012693 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nsdkd"] Jun 09 11:55:51.071440 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.071400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.071588 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.071487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da4eee00-a2f1-448e-a6a4-b58e50974f4d-cert\") pod \"ingress-canary-nsdkd\" (UID: \"da4eee00-a2f1-448e-a6a4-b58e50974f4d\") " pod="openshift-ingress-canary/ingress-canary-nsdkd" Jun 09 11:55:51.071588 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.071519 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a9fb9ea-d453-4b7a-9987-07911094c803-config-volume\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.071588 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.071551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqdb7\" (UniqueName: \"kubernetes.io/projected/da4eee00-a2f1-448e-a6a4-b58e50974f4d-kube-api-access-tqdb7\") pod \"ingress-canary-nsdkd\" (UID: \"da4eee00-a2f1-448e-a6a4-b58e50974f4d\") " pod="openshift-ingress-canary/ingress-canary-nsdkd" Jun 09 11:55:51.071588 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.071575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a9fb9ea-d453-4b7a-9987-07911094c803-tmp-dir\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.071796 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.071594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4qlf\" (UniqueName: \"kubernetes.io/projected/7a9fb9ea-d453-4b7a-9987-07911094c803-kube-api-access-j4qlf\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.172905 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.172878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqdb7\" (UniqueName: \"kubernetes.io/projected/da4eee00-a2f1-448e-a6a4-b58e50974f4d-kube-api-access-tqdb7\") pod \"ingress-canary-nsdkd\" (UID: \"da4eee00-a2f1-448e-a6a4-b58e50974f4d\") " pod="openshift-ingress-canary/ingress-canary-nsdkd" Jun 09 11:55:51.173033 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.172922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a9fb9ea-d453-4b7a-9987-07911094c803-tmp-dir\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.173033 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.172944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4qlf\" (UniqueName: \"kubernetes.io/projected/7a9fb9ea-d453-4b7a-9987-07911094c803-kube-api-access-j4qlf\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.173033 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.173004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.173250 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.173037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da4eee00-a2f1-448e-a6a4-b58e50974f4d-cert\") pod \"ingress-canary-nsdkd\" (UID: \"da4eee00-a2f1-448e-a6a4-b58e50974f4d\") " pod="openshift-ingress-canary/ingress-canary-nsdkd" Jun 09 11:55:51.173250 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.173065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a9fb9ea-d453-4b7a-9987-07911094c803-config-volume\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.173250 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:51.173239 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:51.173391 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:51.173304 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls podName:7a9fb9ea-d453-4b7a-9987-07911094c803 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:51.673283198 +0000 UTC m=+36.545546182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls") pod "dns-default-glnpb" (UID: "7a9fb9ea-d453-4b7a-9987-07911094c803") : secret "dns-default-metrics-tls" not found Jun 09 11:55:51.173391 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.173349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a9fb9ea-d453-4b7a-9987-07911094c803-tmp-dir\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.173596 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.173579 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a9fb9ea-d453-4b7a-9987-07911094c803-config-volume\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.178130 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.177932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da4eee00-a2f1-448e-a6a4-b58e50974f4d-cert\") pod \"ingress-canary-nsdkd\" (UID: \"da4eee00-a2f1-448e-a6a4-b58e50974f4d\") " pod="openshift-ingress-canary/ingress-canary-nsdkd" Jun 09 11:55:51.181380 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.181354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqdb7\" (UniqueName: \"kubernetes.io/projected/da4eee00-a2f1-448e-a6a4-b58e50974f4d-kube-api-access-tqdb7\") pod \"ingress-canary-nsdkd\" (UID: \"da4eee00-a2f1-448e-a6a4-b58e50974f4d\") " pod="openshift-ingress-canary/ingress-canary-nsdkd" Jun 09 11:55:51.181541 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.181467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4qlf\" (UniqueName: \"kubernetes.io/projected/7a9fb9ea-d453-4b7a-9987-07911094c803-kube-api-access-j4qlf\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.320894 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.320857 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nsdkd" Jun 09 11:55:51.447462 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.447428 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nsdkd"] Jun 09 11:55:51.451330 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:55:51.451304 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4eee00_a2f1_448e_a6a4_b58e50974f4d.slice/crio-4c27bfeb62933d9516ff14142dacff31b86bd248797fb9e8ffb5f8755283eade WatchSource:0}: Error finding container 4c27bfeb62933d9516ff14142dacff31b86bd248797fb9e8ffb5f8755283eade: Status 404 returned error can't find the container with id 4c27bfeb62933d9516ff14142dacff31b86bd248797fb9e8ffb5f8755283eade Jun 09 11:55:51.565042 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.564950 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:55:51.565478 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.565112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:55:51.567626 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.567601 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:55:51.567759 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.567627 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:55:51.567759 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.567627 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:55:51.567759 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.567627 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mq88t\"" Jun 09 11:55:51.568277 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.568262 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmll9\"" Jun 09 11:55:51.677301 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.677256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:51.677455 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:51.677436 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:51.677517 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:51.677509 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls podName:7a9fb9ea-d453-4b7a-9987-07911094c803 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:52.677488499 +0000 UTC m=+37.549751469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls") pod "dns-default-glnpb" (UID: "7a9fb9ea-d453-4b7a-9987-07911094c803") : secret "dns-default-metrics-tls" not found Jun 09 11:55:51.725068 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.725032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nsdkd" event={"ID":"da4eee00-a2f1-448e-a6a4-b58e50974f4d","Type":"ContainerStarted","Data":"4c27bfeb62933d9516ff14142dacff31b86bd248797fb9e8ffb5f8755283eade"} Jun 09 11:55:51.729700 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.729674 2562 generic.go:356] "Generic (PLEG): container finished" podID="fbff7d92-6bc3-4703-b53e-1567ba0c77c1" containerID="0a4f2d5f5a2944d246d81973729840465e9564763247022d4e7ad146ade775c5" exitCode=0 Jun 09 11:55:51.729797 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:51.729715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" event={"ID":"fbff7d92-6bc3-4703-b53e-1567ba0c77c1","Type":"ContainerDied","Data":"0a4f2d5f5a2944d246d81973729840465e9564763247022d4e7ad146ade775c5"} Jun 09 11:55:52.562422 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:52.562385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:55:52.565338 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:52.565315 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:55:52.687304 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:52.687256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:52.687475 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:52.687366 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:52.687475 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:52.687439 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls podName:7a9fb9ea-d453-4b7a-9987-07911094c803 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:54.687419018 +0000 UTC m=+39.559681998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls") pod "dns-default-glnpb" (UID: "7a9fb9ea-d453-4b7a-9987-07911094c803") : secret "dns-default-metrics-tls" not found Jun 09 11:55:52.735609 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:52.735575 2562 generic.go:356] "Generic (PLEG): container finished" podID="fbff7d92-6bc3-4703-b53e-1567ba0c77c1" containerID="37ef0ba7c8e629f127ced7795f04bc429f748282ee26e8a3ef86b03ea8aa7977" exitCode=0 Jun 09 11:55:52.735782 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:52.735654 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" event={"ID":"fbff7d92-6bc3-4703-b53e-1567ba0c77c1","Type":"ContainerDied","Data":"37ef0ba7c8e629f127ced7795f04bc429f748282ee26e8a3ef86b03ea8aa7977"} Jun 09 11:55:53.741453 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:53.741420 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" event={"ID":"fbff7d92-6bc3-4703-b53e-1567ba0c77c1","Type":"ContainerStarted","Data":"941e202a1e3d6359f2165596260cef4795dfe099ab8883206bdc42ef7da3d574"} Jun 09 11:55:53.742763 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:53.742739 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nsdkd" event={"ID":"da4eee00-a2f1-448e-a6a4-b58e50974f4d","Type":"ContainerStarted","Data":"969fb04f3c20638b500ac3c2b635a4873f71fd319369065ee5a45e968b0b6bf7"} Jun 09 11:55:53.764792 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:53.764750 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h6gjb" podStartSLOduration=9.166366914 podStartE2EDuration="38.76473613s" totalImagesPullingTime="29.598369216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:53.763356363 +0000 UTC m=+38.635619351" watchObservedRunningTime="2026-06-09 11:55:53.76473613 +0000 UTC m=+38.636999118" Jun 09 11:55:53.779277 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:53.779236 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nsdkd" podStartSLOduration=2.24841352 podStartE2EDuration="3.779224728s" totalImagesPullingTime="1.530811208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:53.778489628 +0000 UTC m=+38.650752617" watchObservedRunningTime="2026-06-09 11:55:53.779224728 +0000 UTC m=+38.651487716" Jun 09 11:55:54.703443 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:54.703407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:54.703593 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:54.703527 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:54.703593 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:54.703579 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls podName:7a9fb9ea-d453-4b7a-9987-07911094c803 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:58.703564429 +0000 UTC m=+43.575827395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls") pod "dns-default-glnpb" (UID: "7a9fb9ea-d453-4b7a-9987-07911094c803") : secret "dns-default-metrics-tls" not found Jun 09 11:55:58.729856 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:55:58.729797 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:55:58.730352 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:58.729952 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:58.730352 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:55:58.730018 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls podName:7a9fb9ea-d453-4b7a-9987-07911094c803 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:06.730001897 +0000 UTC m=+51.602264863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls") pod "dns-default-glnpb" (UID: "7a9fb9ea-d453-4b7a-9987-07911094c803") : secret "dns-default-metrics-tls" not found Jun 09 11:56:06.781397 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:06.781359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:56:06.782099 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:56:06.781515 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:56:06.782099 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:56:06.781601 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls podName:7a9fb9ea-d453-4b7a-9987-07911094c803 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:22.781580928 +0000 UTC m=+67.653843910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls") pod "dns-default-glnpb" (UID: "7a9fb9ea-d453-4b7a-9987-07911094c803") : secret "dns-default-metrics-tls" not found Jun 09 11:56:15.722934 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:15.722907 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kghvx" Jun 09 11:56:21.381312 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.381259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:56:21.381312 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.381311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:56:21.381740 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.381334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:56:21.386329 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.386311 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:56:21.386388 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.386333 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:56:21.386424 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.386387 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:56:21.392503 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:56:21.392483 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:56:21.392580 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:56:21.392550 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs podName:595f3422-e3fc-45b0-94ea-5bebf1b50d6c nodeName:}" failed. No retries permitted until 2026-06-09 11:57:25.392534466 +0000 UTC m=+130.264797431 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs") pod "network-metrics-daemon-grwg5" (UID: "595f3422-e3fc-45b0-94ea-5bebf1b50d6c") : secret "metrics-daemon-secret" not found Jun 09 11:56:21.394970 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.394955 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:56:21.396108 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.396091 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/377b75bb-6ace-4ed4-93fd-0489635ff132-original-pull-secret\") pod \"global-pull-secret-syncer-rgt2r\" (UID: \"377b75bb-6ace-4ed4-93fd-0489635ff132\") " pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:56:21.423460 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.423431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8krq\" (UniqueName: \"kubernetes.io/projected/576579e6-392a-4698-b07c-7b8f3d8d4246-kube-api-access-k8krq\") pod \"network-check-target-29ctw\" (UID: \"576579e6-392a-4698-b07c-7b8f3d8d4246\") " pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:56:21.582242 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.582215 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mq88t\"" Jun 09 11:56:21.590369 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.590347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:56:21.672221 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.672191 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgt2r" Jun 09 11:56:21.717372 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.717336 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-29ctw"] Jun 09 11:56:21.721365 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:56:21.721333 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576579e6_392a_4698_b07c_7b8f3d8d4246.slice/crio-5a474654f3da7622801785712c7077471cc940d1f1f43e47323cc942241a659f WatchSource:0}: Error finding container 5a474654f3da7622801785712c7077471cc940d1f1f43e47323cc942241a659f: Status 404 returned error can't find the container with id 5a474654f3da7622801785712c7077471cc940d1f1f43e47323cc942241a659f Jun 09 11:56:21.799878 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.799844 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rgt2r"] Jun 09 11:56:21.803588 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:56:21.803564 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377b75bb_6ace_4ed4_93fd_0489635ff132.slice/crio-711fb232428b35442fd707c80323a53a481e381c562ae21e14bc7a5b6d0d7986 WatchSource:0}: Error finding container 711fb232428b35442fd707c80323a53a481e381c562ae21e14bc7a5b6d0d7986: Status 404 returned error can't find the container with id 711fb232428b35442fd707c80323a53a481e381c562ae21e14bc7a5b6d0d7986 Jun 09 11:56:21.807498 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.807475 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rgt2r" event={"ID":"377b75bb-6ace-4ed4-93fd-0489635ff132","Type":"ContainerStarted","Data":"711fb232428b35442fd707c80323a53a481e381c562ae21e14bc7a5b6d0d7986"} Jun 09 11:56:21.808548 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:21.808527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-29ctw" event={"ID":"576579e6-392a-4698-b07c-7b8f3d8d4246","Type":"ContainerStarted","Data":"5a474654f3da7622801785712c7077471cc940d1f1f43e47323cc942241a659f"} Jun 09 11:56:22.791350 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:22.791311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:56:22.791782 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:56:22.791487 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:56:22.791782 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:56:22.791563 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls podName:7a9fb9ea-d453-4b7a-9987-07911094c803 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:54.791539513 +0000 UTC m=+99.663802485 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls") pod "dns-default-glnpb" (UID: "7a9fb9ea-d453-4b7a-9987-07911094c803") : secret "dns-default-metrics-tls" not found Jun 09 11:56:26.824078 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:26.824038 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rgt2r" event={"ID":"377b75bb-6ace-4ed4-93fd-0489635ff132","Type":"ContainerStarted","Data":"691cbd1c21107ebead5b3275cabbaee9a0eff05cdaa1359d6f3026239e0297fb"} Jun 09 11:56:26.825403 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:26.825382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-29ctw" event={"ID":"576579e6-392a-4698-b07c-7b8f3d8d4246","Type":"ContainerStarted","Data":"f6973d449c84bde56f83b82b3e43b13377ccd117fd25ad409019d08e582cbbcb"} Jun 09 11:56:26.825520 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:26.825505 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:56:26.843788 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:26.843745 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rgt2r" podStartSLOduration=67.581426199 podStartE2EDuration="1m11.843725079s" totalImagesPullingTime="4.26229888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:56:26.843481225 +0000 UTC m=+71.715744215" watchObservedRunningTime="2026-06-09 11:56:26.843725079 +0000 UTC m=+71.715988066" Jun 09 11:56:54.809231 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:54.809179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:56:54.809753 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:56:54.809352 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:56:54.809753 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:56:54.809443 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls podName:7a9fb9ea-d453-4b7a-9987-07911094c803 nodeName:}" failed. No retries permitted until 2026-06-09 11:57:58.809423929 +0000 UTC m=+163.681686911 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls") pod "dns-default-glnpb" (UID: "7a9fb9ea-d453-4b7a-9987-07911094c803") : secret "dns-default-metrics-tls" not found Jun 09 11:56:57.830337 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:57.830309 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-29ctw" Jun 09 11:56:57.852323 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:56:57.852274 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-29ctw" podStartSLOduration=98.511803026 podStartE2EDuration="1m42.85225727s" totalImagesPullingTime="4.340454244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:56:26.865042908 +0000 UTC m=+71.737305907" watchObservedRunningTime="2026-06-09 11:56:57.85225727 +0000 UTC m=+102.724520259" Jun 09 11:57:25.414514 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:57:25.414478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:57:25.415027 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:57:25.414626 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:57:25.415027 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:57:25.414700 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs podName:595f3422-e3fc-45b0-94ea-5bebf1b50d6c nodeName:}" failed. No retries permitted until 2026-06-09 11:59:27.414685154 +0000 UTC m=+252.286948123 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs") pod "network-metrics-daemon-grwg5" (UID: "595f3422-e3fc-45b0-94ea-5bebf1b50d6c") : secret "metrics-daemon-secret" not found Jun 09 11:57:54.014411 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:57:54.014370 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-glnpb" podUID="7a9fb9ea-d453-4b7a-9987-07911094c803" Jun 09 11:57:54.022284 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:57:54.022259 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-glnpb" Jun 09 11:57:54.574646 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:57:54.574593 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-grwg5" podUID="595f3422-e3fc-45b0-94ea-5bebf1b50d6c" Jun 09 11:57:58.825582 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:57:58.825529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 11:57:58.826121 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:57:58.825675 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:57:58.826121 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:57:58.825746 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls podName:7a9fb9ea-d453-4b7a-9987-07911094c803 nodeName:}" failed. No retries permitted until 2026-06-09 12:00:00.825731767 +0000 UTC m=+285.697994739 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls") pod "dns-default-glnpb" (UID: "7a9fb9ea-d453-4b7a-9987-07911094c803") : secret "dns-default-metrics-tls" not found Jun 09 11:58:05.563629 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:58:05.563526 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:59:08.570468 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.570428 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh"] Jun 09 11:59:08.572241 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.572225 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-j4x8s"] Jun 09 11:59:08.572366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.572346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:08.573790 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.573774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.576654 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.576633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 11:59:08.576738 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.576678 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 11:59:08.576965 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.576949 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9mh6f\"" Jun 09 11:59:08.577025 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.576984 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 11:59:08.577071 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.577054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 11:59:08.577944 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.577927 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 11:59:08.578466 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.578449 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tp5tj\"" Jun 09 11:59:08.584119 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.584099 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 11:59:08.584966 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.584951 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 11:59:08.591265 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.591245 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh"] Jun 09 11:59:08.592046 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.592024 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-j4x8s"] Jun 09 11:59:08.662989 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.662955 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n"] Jun 09 11:59:08.665097 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.665076 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b557d5689-j6d6t"] Jun 09 11:59:08.665233 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.665190 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n" Jun 09 11:59:08.666728 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.666710 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4"] Jun 09 11:59:08.666875 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.666858 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.667466 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.667445 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tx9sd\"" Jun 09 11:59:08.668327 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.668314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4" Jun 09 11:59:08.669769 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.669756 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p8scl\"" Jun 09 11:59:08.670048 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.670035 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 11:59:08.670120 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.670038 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 11:59:08.670249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.670226 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 11:59:08.670249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.670240 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 11:59:08.671113 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.671091 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 11:59:08.671204 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.671128 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zwpdd\"" Jun 09 11:59:08.671204 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.671159 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:08.671204 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.671172 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 11:59:08.671204 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.671172 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:08.679201 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.679182 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n"] Jun 09 11:59:08.680352 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.680333 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4"] Jun 09 11:59:08.680712 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.680694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3210dd5c-7a75-4748-8e92-e03a30b00980-service-ca-bundle\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.680712 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.680721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3210dd5c-7a75-4748-8e92-e03a30b00980-tmp\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.680930 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.680763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3210dd5c-7a75-4748-8e92-e03a30b00980-trusted-ca-bundle\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.680930 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.680802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3210dd5c-7a75-4748-8e92-e03a30b00980-serving-cert\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.680930 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.680853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q2pd\" (UniqueName: \"kubernetes.io/projected/3210dd5c-7a75-4748-8e92-e03a30b00980-kube-api-access-6q2pd\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.680930 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.680876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:08.680930 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.680919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e8db230-c3dc-47e2-b74d-e2aab2770133-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:08.681184 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.680946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3210dd5c-7a75-4748-8e92-e03a30b00980-snapshots\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.681708 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.681688 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b557d5689-j6d6t"] Jun 09 11:59:08.767139 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.767108 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8rmgp"] Jun 09 11:59:08.768927 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.768912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.771668 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.771646 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:08.771794 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.771779 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:08.771865 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.771825 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 11:59:08.771905 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.771869 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 11:59:08.771905 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.771885 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jsc7s\"" Jun 09 11:59:08.779486 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.779468 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 11:59:08.782205 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3210dd5c-7a75-4748-8e92-e03a30b00980-tmp\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.782273 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-stats-auth\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.782273 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3210dd5c-7a75-4748-8e92-e03a30b00980-trusted-ca-bundle\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.782338 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3210dd5c-7a75-4748-8e92-e03a30b00980-serving-cert\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.782384 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2pd\" (UniqueName: \"kubernetes.io/projected/3210dd5c-7a75-4748-8e92-e03a30b00980-kube-api-access-6q2pd\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.782430 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:08.782430 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs95b\" (UniqueName: \"kubernetes.io/projected/1d132536-27c1-427d-b69a-594701f5276f-kube-api-access-gs95b\") pod \"network-check-source-dbd9cf844-6kz8n\" (UID: \"1d132536-27c1-427d-b69a-594701f5276f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n" Jun 09 11:59:08.782501 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.782537 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:08.782507 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:08.782574 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgdwk\" (UniqueName: \"kubernetes.io/projected/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-kube-api-access-wgdwk\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.782616 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:08.782577 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert podName:9e8db230-c3dc-47e2-b74d-e2aab2770133 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.282559225 +0000 UTC m=+234.154822209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kqbnh" (UID: "9e8db230-c3dc-47e2-b74d-e2aab2770133") : secret "networking-console-plugin-cert" not found Jun 09 11:59:08.782616 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782599 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czcs5\" (UniqueName: \"kubernetes.io/projected/671ccb9a-9d87-4187-88e6-d0862c5c181c-kube-api-access-czcs5\") pod \"volume-data-source-validator-78dd696465-zjjn4\" (UID: \"671ccb9a-9d87-4187-88e6-d0862c5c181c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4" Jun 09 11:59:08.782700 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782616 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3210dd5c-7a75-4748-8e92-e03a30b00980-tmp\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.782700 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.782700 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e8db230-c3dc-47e2-b74d-e2aab2770133-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:08.782869 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3210dd5c-7a75-4748-8e92-e03a30b00980-snapshots\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.782869 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-default-certificate\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.782869 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.782775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3210dd5c-7a75-4748-8e92-e03a30b00980-service-ca-bundle\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.783132 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.783113 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3210dd5c-7a75-4748-8e92-e03a30b00980-trusted-ca-bundle\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.783277 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.783256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3210dd5c-7a75-4748-8e92-e03a30b00980-service-ca-bundle\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.783337 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.783310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e8db230-c3dc-47e2-b74d-e2aab2770133-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:08.783379 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.783362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3210dd5c-7a75-4748-8e92-e03a30b00980-snapshots\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.784558 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.784540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3210dd5c-7a75-4748-8e92-e03a30b00980-serving-cert\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.789938 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.789912 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8rmgp"] Jun 09 11:59:08.798482 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.798460 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q2pd\" (UniqueName: \"kubernetes.io/projected/3210dd5c-7a75-4748-8e92-e03a30b00980-kube-api-access-6q2pd\") pod \"insights-operator-896549976-j4x8s\" (UID: \"3210dd5c-7a75-4748-8e92-e03a30b00980\") " pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.883957 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.883862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs95b\" (UniqueName: \"kubernetes.io/projected/1d132536-27c1-427d-b69a-594701f5276f-kube-api-access-gs95b\") pod \"network-check-source-dbd9cf844-6kz8n\" (UID: \"1d132536-27c1-427d-b69a-594701f5276f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n" Jun 09 11:59:08.883957 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.883905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.883957 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.883933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgdwk\" (UniqueName: \"kubernetes.io/projected/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-kube-api-access-wgdwk\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.884246 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:08.884028 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:08.884246 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.884064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcs5\" (UniqueName: \"kubernetes.io/projected/671ccb9a-9d87-4187-88e6-d0862c5c181c-kube-api-access-czcs5\") pod \"volume-data-source-validator-78dd696465-zjjn4\" (UID: \"671ccb9a-9d87-4187-88e6-d0862c5c181c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4" Jun 09 11:59:08.884246 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:08.884091 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.384075964 +0000 UTC m=+234.256338930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : secret "router-metrics-certs-default" not found Jun 09 11:59:08.884246 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.884119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.884246 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.884138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-serving-cert\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.884246 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.884162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-trusted-ca\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.884246 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.884181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vx8t\" (UniqueName: \"kubernetes.io/projected/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-kube-api-access-7vx8t\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.884246 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.884232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-default-certificate\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.884558 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.884256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-stats-auth\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.884558 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:08.884279 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.384261193 +0000 UTC m=+234.256524160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:08.884558 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.884389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-config\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.886613 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.886593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-stats-auth\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.886709 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.886625 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-default-certificate\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.887396 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.887380 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-j4x8s" Jun 09 11:59:08.892874 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.892857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czcs5\" (UniqueName: \"kubernetes.io/projected/671ccb9a-9d87-4187-88e6-d0862c5c181c-kube-api-access-czcs5\") pod \"volume-data-source-validator-78dd696465-zjjn4\" (UID: \"671ccb9a-9d87-4187-88e6-d0862c5c181c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4" Jun 09 11:59:08.893487 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.893466 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs95b\" (UniqueName: \"kubernetes.io/projected/1d132536-27c1-427d-b69a-594701f5276f-kube-api-access-gs95b\") pod \"network-check-source-dbd9cf844-6kz8n\" (UID: \"1d132536-27c1-427d-b69a-594701f5276f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n" Jun 09 11:59:08.894043 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.894017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgdwk\" (UniqueName: \"kubernetes.io/projected/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-kube-api-access-wgdwk\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:08.975239 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.975209 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n" Jun 09 11:59:08.985308 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.985287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-serving-cert\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.985404 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.985319 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-trusted-ca\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.985404 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.985339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vx8t\" (UniqueName: \"kubernetes.io/projected/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-kube-api-access-7vx8t\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.985404 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.985375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-config\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.986227 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.986195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-config\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.986334 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.986209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-trusted-ca\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.987688 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.987579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4" Jun 09 11:59:08.987797 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.987776 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-serving-cert\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:08.995942 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:08.995918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vx8t\" (UniqueName: \"kubernetes.io/projected/baa81a0d-4a24-42f3-a8b3-06bdaaa795df-kube-api-access-7vx8t\") pod \"console-operator-668fdbf85c-8rmgp\" (UID: \"baa81a0d-4a24-42f3-a8b3-06bdaaa795df\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:09.008732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.008708 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-j4x8s"] Jun 09 11:59:09.011891 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:09.011858 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3210dd5c_7a75_4748_8e92_e03a30b00980.slice/crio-20a58d22fe1bd4e4e7dc5b61bc5177eb2dd0159cb7600114ecc888ed6d55a512 WatchSource:0}: Error finding container 20a58d22fe1bd4e4e7dc5b61bc5177eb2dd0159cb7600114ecc888ed6d55a512: Status 404 returned error can't find the container with id 20a58d22fe1bd4e4e7dc5b61bc5177eb2dd0159cb7600114ecc888ed6d55a512 Jun 09 11:59:09.078170 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.078081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:09.108928 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.108895 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n"] Jun 09 11:59:09.111872 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:09.111846 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d132536_27c1_427d_b69a_594701f5276f.slice/crio-357ca68187f720dc2788bcc1b6ede92ffedca5cdc056a3588e4e2cd8258586ad WatchSource:0}: Error finding container 357ca68187f720dc2788bcc1b6ede92ffedca5cdc056a3588e4e2cd8258586ad: Status 404 returned error can't find the container with id 357ca68187f720dc2788bcc1b6ede92ffedca5cdc056a3588e4e2cd8258586ad Jun 09 11:59:09.123352 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.123331 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4"] Jun 09 11:59:09.126018 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:09.125996 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671ccb9a_9d87_4187_88e6_d0862c5c181c.slice/crio-9a7cfbb253157eedde1ea8f9a9a4b11720cbde7c6daae3e8cad34e6bdd775f81 WatchSource:0}: Error finding container 9a7cfbb253157eedde1ea8f9a9a4b11720cbde7c6daae3e8cad34e6bdd775f81: Status 404 returned error can't find the container with id 9a7cfbb253157eedde1ea8f9a9a4b11720cbde7c6daae3e8cad34e6bdd775f81 Jun 09 11:59:09.191455 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.191418 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4" event={"ID":"671ccb9a-9d87-4187-88e6-d0862c5c181c","Type":"ContainerStarted","Data":"9a7cfbb253157eedde1ea8f9a9a4b11720cbde7c6daae3e8cad34e6bdd775f81"} Jun 09 11:59:09.193172 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.193137 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n" event={"ID":"1d132536-27c1-427d-b69a-594701f5276f","Type":"ContainerStarted","Data":"faeba36a78442613f4c045f1e75c93a6e7d21748074a2a5f7019261c53283876"} Jun 09 11:59:09.193317 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.193223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n" event={"ID":"1d132536-27c1-427d-b69a-594701f5276f","Type":"ContainerStarted","Data":"357ca68187f720dc2788bcc1b6ede92ffedca5cdc056a3588e4e2cd8258586ad"} Jun 09 11:59:09.194313 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.194290 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-j4x8s" event={"ID":"3210dd5c-7a75-4748-8e92-e03a30b00980","Type":"ContainerStarted","Data":"20a58d22fe1bd4e4e7dc5b61bc5177eb2dd0159cb7600114ecc888ed6d55a512"} Jun 09 11:59:09.209006 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.208981 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8rmgp"] Jun 09 11:59:09.211716 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.211548 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-6kz8n" podStartSLOduration=1.211529559 podStartE2EDuration="1.211529559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:09.211458873 +0000 UTC m=+234.083721860" watchObservedRunningTime="2026-06-09 11:59:09.211529559 +0000 UTC m=+234.083792548" Jun 09 11:59:09.212451 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:09.212429 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa81a0d_4a24_42f3_a8b3_06bdaaa795df.slice/crio-dbd414171a575b1eb145338ffc8ec01ee26898a6dfb452c3042f34fcf75f4b6b WatchSource:0}: Error finding container dbd414171a575b1eb145338ffc8ec01ee26898a6dfb452c3042f34fcf75f4b6b: Status 404 returned error can't find the container with id dbd414171a575b1eb145338ffc8ec01ee26898a6dfb452c3042f34fcf75f4b6b Jun 09 11:59:09.288717 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.288687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:09.288885 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:09.288844 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:09.288924 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:09.288908 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert podName:9e8db230-c3dc-47e2-b74d-e2aab2770133 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:10.288890081 +0000 UTC m=+235.161153064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kqbnh" (UID: "9e8db230-c3dc-47e2-b74d-e2aab2770133") : secret "networking-console-plugin-cert" not found Jun 09 11:59:09.389584 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.389499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:09.389584 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:09.389532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:09.389781 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:09.389675 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:09.389781 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:09.389728 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:10.389711362 +0000 UTC m=+235.261974329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:09.389781 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:09.389749 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:10.389742796 +0000 UTC m=+235.262005761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : secret "router-metrics-certs-default" not found Jun 09 11:59:10.202808 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:10.202742 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" event={"ID":"baa81a0d-4a24-42f3-a8b3-06bdaaa795df","Type":"ContainerStarted","Data":"dbd414171a575b1eb145338ffc8ec01ee26898a6dfb452c3042f34fcf75f4b6b"} Jun 09 11:59:10.299269 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:10.299227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:10.299726 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:10.299575 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:10.299726 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:10.299655 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert podName:9e8db230-c3dc-47e2-b74d-e2aab2770133 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:12.299634608 +0000 UTC m=+237.171897576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kqbnh" (UID: "9e8db230-c3dc-47e2-b74d-e2aab2770133") : secret "networking-console-plugin-cert" not found Jun 09 11:59:10.399975 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:10.399741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:10.399975 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:10.399799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:10.399975 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:10.399881 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:10.399975 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:10.399947 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:12.399930155 +0000 UTC m=+237.272193126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : secret "router-metrics-certs-default" not found Jun 09 11:59:10.399975 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:10.399965 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:12.39995638 +0000 UTC m=+237.272219346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:11.207975 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:11.207934 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4" event={"ID":"671ccb9a-9d87-4187-88e6-d0862c5c181c","Type":"ContainerStarted","Data":"b1c339e6d63b0b4b39d08e2c19ac629a602fcb6a52cbc9abbdec2e61fa2b253a"} Jun 09 11:59:11.226383 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:11.226335 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zjjn4" podStartSLOduration=2.218733526 podStartE2EDuration="3.226315295s" totalImagesPullingTime="1.007581769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:11.226240583 +0000 UTC m=+236.098503573" watchObservedRunningTime="2026-06-09 11:59:11.226315295 +0000 UTC m=+236.098578286" Jun 09 11:59:12.212895 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:12.212869 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/0.log" Jun 09 11:59:12.213361 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:12.212907 2562 generic.go:356] "Generic (PLEG): container finished" podID="baa81a0d-4a24-42f3-a8b3-06bdaaa795df" containerID="03c6b88ae4830773569e9cc6912d928013abd6d73da5984ef7e3705bac0595e1" exitCode=255 Jun 09 11:59:12.213361 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:12.212937 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" event={"ID":"baa81a0d-4a24-42f3-a8b3-06bdaaa795df","Type":"ContainerDied","Data":"03c6b88ae4830773569e9cc6912d928013abd6d73da5984ef7e3705bac0595e1"} Jun 09 11:59:12.213361 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:12.213169 2562 scope.go:117] "RemoveContainer" containerID="03c6b88ae4830773569e9cc6912d928013abd6d73da5984ef7e3705bac0595e1" Jun 09 11:59:12.214549 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:12.214524 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-j4x8s" event={"ID":"3210dd5c-7a75-4748-8e92-e03a30b00980","Type":"ContainerStarted","Data":"218d9303f363258a57078b84e38e8b547edb25ce66298977f0c9d99b55bdb214"} Jun 09 11:59:12.245071 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:12.245015 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-j4x8s" podStartSLOduration=1.9069194619999998 podStartE2EDuration="4.244996695s" totalImagesPullingTime="2.338077233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:12.244395577 +0000 UTC m=+237.116658567" watchObservedRunningTime="2026-06-09 11:59:12.244996695 +0000 UTC m=+237.117259685" Jun 09 11:59:12.313921 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:12.313883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:12.314562 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:12.313996 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:12.314562 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:12.314360 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert podName:9e8db230-c3dc-47e2-b74d-e2aab2770133 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:16.314332451 +0000 UTC m=+241.186595435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kqbnh" (UID: "9e8db230-c3dc-47e2-b74d-e2aab2770133") : secret "networking-console-plugin-cert" not found Jun 09 11:59:12.414829 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:12.414780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:12.414993 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:12.414864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:12.414993 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:12.414922 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:12.414993 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:12.414986 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:16.414971524 +0000 UTC m=+241.287234489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : secret "router-metrics-certs-default" not found Jun 09 11:59:12.415111 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:12.415001 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:16.414995263 +0000 UTC m=+241.287258229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:13.095938 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.095903 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh"] Jun 09 11:59:13.097748 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.097732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh" Jun 09 11:59:13.100647 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.100615 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:13.101329 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.101310 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xdghn\"" Jun 09 11:59:13.102255 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.102235 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 11:59:13.111074 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.111041 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh"] Jun 09 11:59:13.219796 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.219765 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/1.log" Jun 09 11:59:13.220198 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.220145 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/0.log" Jun 09 11:59:13.220198 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.220178 2562 generic.go:356] "Generic (PLEG): container finished" podID="baa81a0d-4a24-42f3-a8b3-06bdaaa795df" containerID="6a42242359cc4334f6544a32a7b4ed4cde62fd030d7f6ca2d48061fdbc6c4964" exitCode=255 Jun 09 11:59:13.220279 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.220266 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" event={"ID":"baa81a0d-4a24-42f3-a8b3-06bdaaa795df","Type":"ContainerDied","Data":"6a42242359cc4334f6544a32a7b4ed4cde62fd030d7f6ca2d48061fdbc6c4964"} Jun 09 11:59:13.220330 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.220322 2562 scope.go:117] "RemoveContainer" containerID="03c6b88ae4830773569e9cc6912d928013abd6d73da5984ef7e3705bac0595e1" Jun 09 11:59:13.220514 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.220491 2562 scope.go:117] "RemoveContainer" containerID="6a42242359cc4334f6544a32a7b4ed4cde62fd030d7f6ca2d48061fdbc6c4964" Jun 09 11:59:13.220655 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.220632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2mw\" (UniqueName: \"kubernetes.io/projected/c75c82e4-bc79-4c6d-89fc-72363719a044-kube-api-access-jt2mw\") pod \"migrator-955ffdf5f-vchkh\" (UID: \"c75c82e4-bc79-4c6d-89fc-72363719a044\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh" Jun 09 11:59:13.220737 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:13.220714 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8rmgp_openshift-console-operator(baa81a0d-4a24-42f3-a8b3-06bdaaa795df)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" podUID="baa81a0d-4a24-42f3-a8b3-06bdaaa795df" Jun 09 11:59:13.322096 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.322050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2mw\" (UniqueName: \"kubernetes.io/projected/c75c82e4-bc79-4c6d-89fc-72363719a044-kube-api-access-jt2mw\") pod \"migrator-955ffdf5f-vchkh\" (UID: \"c75c82e4-bc79-4c6d-89fc-72363719a044\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh" Jun 09 11:59:13.332267 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.332236 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2mw\" (UniqueName: \"kubernetes.io/projected/c75c82e4-bc79-4c6d-89fc-72363719a044-kube-api-access-jt2mw\") pod \"migrator-955ffdf5f-vchkh\" (UID: \"c75c82e4-bc79-4c6d-89fc-72363719a044\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh" Jun 09 11:59:13.406648 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.406567 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh" Jun 09 11:59:13.540130 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:13.540106 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh"] Jun 09 11:59:13.541998 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:13.541967 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75c82e4_bc79_4c6d_89fc_72363719a044.slice/crio-08b265893008f0b23bd7bbdc3c3b594f655c179ffd7c7fa866a1e2114194d897 WatchSource:0}: Error finding container 08b265893008f0b23bd7bbdc3c3b594f655c179ffd7c7fa866a1e2114194d897: Status 404 returned error can't find the container with id 08b265893008f0b23bd7bbdc3c3b594f655c179ffd7c7fa866a1e2114194d897 Jun 09 11:59:14.224322 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:14.224267 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh" event={"ID":"c75c82e4-bc79-4c6d-89fc-72363719a044","Type":"ContainerStarted","Data":"08b265893008f0b23bd7bbdc3c3b594f655c179ffd7c7fa866a1e2114194d897"} Jun 09 11:59:14.226011 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:14.225988 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/1.log" Jun 09 11:59:14.226317 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:14.226301 2562 scope.go:117] "RemoveContainer" containerID="6a42242359cc4334f6544a32a7b4ed4cde62fd030d7f6ca2d48061fdbc6c4964" Jun 09 11:59:14.226491 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:14.226473 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8rmgp_openshift-console-operator(baa81a0d-4a24-42f3-a8b3-06bdaaa795df)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" podUID="baa81a0d-4a24-42f3-a8b3-06bdaaa795df" Jun 09 11:59:14.529148 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:14.529120 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pb7fh_363c33d6-6510-4dc4-b6a4-b4c3b600bdb9/dns-node-resolver/0.log" Jun 09 11:59:15.231329 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:15.231293 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh" event={"ID":"c75c82e4-bc79-4c6d-89fc-72363719a044","Type":"ContainerStarted","Data":"ecbaba6b036e424795876e96c3a0afceca6233b8431708e902b2246df1e2663c"} Jun 09 11:59:15.231746 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:15.231350 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh" event={"ID":"c75c82e4-bc79-4c6d-89fc-72363719a044","Type":"ContainerStarted","Data":"f2c354077716dd1b5982fd7cbb1a724b91ac71b39e51127812b4592dae15dd55"} Jun 09 11:59:15.247967 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:15.247922 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vchkh" podStartSLOduration=1.413270912 podStartE2EDuration="2.247906817s" totalImagesPullingTime="834.635905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:15.246355086 +0000 UTC m=+240.118618073" watchObservedRunningTime="2026-06-09 11:59:15.247906817 +0000 UTC m=+240.120169805" Jun 09 11:59:15.333539 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:15.333512 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fd8t9_1d1e36e7-7f10-4b1b-970f-2253327f8836/node-ca/0.log" Jun 09 11:59:16.349225 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:16.349187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:16.349596 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:16.349329 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:16.349596 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:16.349397 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert podName:9e8db230-c3dc-47e2-b74d-e2aab2770133 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:24.349378999 +0000 UTC m=+249.221641965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kqbnh" (UID: "9e8db230-c3dc-47e2-b74d-e2aab2770133") : secret "networking-console-plugin-cert" not found Jun 09 11:59:16.450573 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:16.450538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:16.450573 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:16.450572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:16.450769 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:16.450687 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:16.450769 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:16.450687 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:24.45067365 +0000 UTC m=+249.322936617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:16.450769 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:16.450748 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs podName:b44287d9-a75c-4f23-8f8e-afd6f07dd79e nodeName:}" failed. No retries permitted until 2026-06-09 11:59:24.450735332 +0000 UTC m=+249.322998298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs") pod "router-default-5b557d5689-j6d6t" (UID: "b44287d9-a75c-4f23-8f8e-afd6f07dd79e") : secret "router-metrics-certs-default" not found Jun 09 11:59:16.530381 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:16.530355 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nsdkd_da4eee00-a2f1-448e-a6a4-b58e50974f4d/serve-healthcheck-canary/0.log" Jun 09 11:59:19.078827 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:19.078794 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:19.079296 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:19.078854 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:19.079296 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:19.079275 2562 scope.go:117] "RemoveContainer" containerID="6a42242359cc4334f6544a32a7b4ed4cde62fd030d7f6ca2d48061fdbc6c4964" Jun 09 11:59:19.079468 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:19.079448 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8rmgp_openshift-console-operator(baa81a0d-4a24-42f3-a8b3-06bdaaa795df)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" podUID="baa81a0d-4a24-42f3-a8b3-06bdaaa795df" Jun 09 11:59:24.416016 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.415966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:24.418357 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.418336 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e8db230-c3dc-47e2-b74d-e2aab2770133-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kqbnh\" (UID: \"9e8db230-c3dc-47e2-b74d-e2aab2770133\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:24.484034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.484006 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9mh6f\"" Jun 09 11:59:24.491941 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.491924 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" Jun 09 11:59:24.516670 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.516639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:24.516780 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.516677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:24.517279 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.517259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-service-ca-bundle\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:24.518859 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.518837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b44287d9-a75c-4f23-8f8e-afd6f07dd79e-metrics-certs\") pod \"router-default-5b557d5689-j6d6t\" (UID: \"b44287d9-a75c-4f23-8f8e-afd6f07dd79e\") " pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:24.584556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.584533 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p8scl\"" Jun 09 11:59:24.592556 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.592531 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:24.611144 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.611122 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh"] Jun 09 11:59:24.614488 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:24.614463 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8db230_c3dc_47e2_b74d_e2aab2770133.slice/crio-de25d13a98630f5422a432edb5aa2cee8a220e157d7c3ff0165a804c543034d7 WatchSource:0}: Error finding container de25d13a98630f5422a432edb5aa2cee8a220e157d7c3ff0165a804c543034d7: Status 404 returned error can't find the container with id de25d13a98630f5422a432edb5aa2cee8a220e157d7c3ff0165a804c543034d7 Jun 09 11:59:24.714301 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:24.714269 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b557d5689-j6d6t"] Jun 09 11:59:24.717230 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:24.717207 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44287d9_a75c_4f23_8f8e_afd6f07dd79e.slice/crio-72a419ae230d08b7d7fa6551eac1f21b983fc7419e39bfff070c79f4a6857c73 WatchSource:0}: Error finding container 72a419ae230d08b7d7fa6551eac1f21b983fc7419e39bfff070c79f4a6857c73: Status 404 returned error can't find the container with id 72a419ae230d08b7d7fa6551eac1f21b983fc7419e39bfff070c79f4a6857c73 Jun 09 11:59:25.263577 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:25.263538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b557d5689-j6d6t" event={"ID":"b44287d9-a75c-4f23-8f8e-afd6f07dd79e","Type":"ContainerStarted","Data":"244655caca80ba20b27d1774357f9c7c330b22972daa9b532cd4e42f90283753"} Jun 09 11:59:25.263774 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:25.263614 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b557d5689-j6d6t" event={"ID":"b44287d9-a75c-4f23-8f8e-afd6f07dd79e","Type":"ContainerStarted","Data":"72a419ae230d08b7d7fa6551eac1f21b983fc7419e39bfff070c79f4a6857c73"} Jun 09 11:59:25.264737 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:25.264706 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" event={"ID":"9e8db230-c3dc-47e2-b74d-e2aab2770133","Type":"ContainerStarted","Data":"de25d13a98630f5422a432edb5aa2cee8a220e157d7c3ff0165a804c543034d7"} Jun 09 11:59:25.283628 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:25.283573 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b557d5689-j6d6t" podStartSLOduration=17.283558987 podStartE2EDuration="17.283558987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:25.282624187 +0000 UTC m=+250.154887224" watchObservedRunningTime="2026-06-09 11:59:25.283558987 +0000 UTC m=+250.155821974" Jun 09 11:59:25.592828 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:25.592794 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:25.595671 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:25.595651 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:26.269281 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:26.269244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" event={"ID":"9e8db230-c3dc-47e2-b74d-e2aab2770133","Type":"ContainerStarted","Data":"66f323af80a71aded63ff2f216f785518ff9310a63b85352634cf8b3eaacb53a"} Jun 09 11:59:26.269450 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:26.269334 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:26.270639 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:26.270619 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b557d5689-j6d6t" Jun 09 11:59:26.288951 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:26.288910 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kqbnh" podStartSLOduration=17.322609442 podStartE2EDuration="18.288898187s" totalImagesPullingTime="966.288745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:26.288415776 +0000 UTC m=+251.160678774" watchObservedRunningTime="2026-06-09 11:59:26.288898187 +0000 UTC m=+251.161161174" Jun 09 11:59:27.438541 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:27.438506 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:59:27.440858 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:27.440835 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/595f3422-e3fc-45b0-94ea-5bebf1b50d6c-metrics-certs\") pod \"network-metrics-daemon-grwg5\" (UID: \"595f3422-e3fc-45b0-94ea-5bebf1b50d6c\") " pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:59:27.466424 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:27.466400 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmll9\"" Jun 09 11:59:27.474604 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:27.474587 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwg5" Jun 09 11:59:27.596154 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:27.596127 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-grwg5"] Jun 09 11:59:27.599147 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:27.599116 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595f3422_e3fc_45b0_94ea_5bebf1b50d6c.slice/crio-3b7a0855184d55a8a45487ffbdde0ff3a33d5cdf9ee54beeca2be544471a3cef WatchSource:0}: Error finding container 3b7a0855184d55a8a45487ffbdde0ff3a33d5cdf9ee54beeca2be544471a3cef: Status 404 returned error can't find the container with id 3b7a0855184d55a8a45487ffbdde0ff3a33d5cdf9ee54beeca2be544471a3cef Jun 09 11:59:28.277058 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:28.277013 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grwg5" event={"ID":"595f3422-e3fc-45b0-94ea-5bebf1b50d6c","Type":"ContainerStarted","Data":"3b7a0855184d55a8a45487ffbdde0ff3a33d5cdf9ee54beeca2be544471a3cef"} Jun 09 11:59:29.284564 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:29.284524 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grwg5" event={"ID":"595f3422-e3fc-45b0-94ea-5bebf1b50d6c","Type":"ContainerStarted","Data":"3f48a3b25b369712abf9a14605775d59049e085fc97aed2ad4f4c8938d220d0f"} Jun 09 11:59:29.285013 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:29.284590 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grwg5" event={"ID":"595f3422-e3fc-45b0-94ea-5bebf1b50d6c","Type":"ContainerStarted","Data":"7fa09c5b0b0c9da4dfb4f1b0d501938b8ce8f47fd6cb9cbed3e7fe9d5c0fa7f4"} Jun 09 11:59:29.300772 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:29.300723 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-grwg5" podStartSLOduration=253.498373893 podStartE2EDuration="4m14.300706753s" totalImagesPullingTime="802.33286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:29.299862685 +0000 UTC m=+254.172125675" watchObservedRunningTime="2026-06-09 11:59:29.300706753 +0000 UTC m=+254.172969741" Jun 09 11:59:33.562584 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:33.562503 2562 scope.go:117] "RemoveContainer" containerID="6a42242359cc4334f6544a32a7b4ed4cde62fd030d7f6ca2d48061fdbc6c4964" Jun 09 11:59:34.301673 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:34.301642 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 11:59:34.302068 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:34.302052 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/1.log" Jun 09 11:59:34.302121 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:34.302085 2562 generic.go:356] "Generic (PLEG): container finished" podID="baa81a0d-4a24-42f3-a8b3-06bdaaa795df" containerID="5e1128e4a3ce585f4ba522b15209feec149e4eebb8cf86eabafe8311994d73b7" exitCode=255 Jun 09 11:59:34.302121 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:34.302108 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" event={"ID":"baa81a0d-4a24-42f3-a8b3-06bdaaa795df","Type":"ContainerDied","Data":"5e1128e4a3ce585f4ba522b15209feec149e4eebb8cf86eabafe8311994d73b7"} Jun 09 11:59:34.302184 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:34.302145 2562 scope.go:117] "RemoveContainer" containerID="6a42242359cc4334f6544a32a7b4ed4cde62fd030d7f6ca2d48061fdbc6c4964" Jun 09 11:59:34.302463 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:34.302443 2562 scope.go:117] "RemoveContainer" containerID="5e1128e4a3ce585f4ba522b15209feec149e4eebb8cf86eabafe8311994d73b7" Jun 09 11:59:34.302644 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:34.302625 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-8rmgp_openshift-console-operator(baa81a0d-4a24-42f3-a8b3-06bdaaa795df)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" podUID="baa81a0d-4a24-42f3-a8b3-06bdaaa795df" Jun 09 11:59:35.306861 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:35.306832 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 11:59:38.035710 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.035678 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7"] Jun 09 11:59:38.040066 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.039977 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b2n79"] Jun 09 11:59:38.040141 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.040092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" Jun 09 11:59:38.042799 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.042774 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-q8vbk\"" Jun 09 11:59:38.043323 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.043297 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.043431 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.043366 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 11:59:38.045561 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.045532 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 11:59:38.045826 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.045786 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 11:59:38.045954 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.045850 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s4x4b\"" Jun 09 11:59:38.054629 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.054588 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7"] Jun 09 11:59:38.058732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.058701 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b2n79"] Jun 09 11:59:38.099452 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.099422 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84c6dfb985-66pc2"] Jun 09 11:59:38.102348 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.102332 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.104690 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.104668 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 11:59:38.104805 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.104692 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-frx5g\"" Jun 09 11:59:38.104805 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.104671 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 11:59:38.104805 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.104669 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 11:59:38.110108 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.110091 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 11:59:38.118230 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.118210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e064597-2eef-4676-9a3e-ff5e6966c41b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.118334 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.118238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd6pm\" (UniqueName: \"kubernetes.io/projected/9e064597-2eef-4676-9a3e-ff5e6966c41b-kube-api-access-wd6pm\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.118334 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.118263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e064597-2eef-4676-9a3e-ff5e6966c41b-crio-socket\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.118334 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.118297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e064597-2eef-4676-9a3e-ff5e6966c41b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.118472 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.118411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bf13fd1-b972-4fd3-8e08-e469469cce93-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j6cm7\" (UID: \"3bf13fd1-b972-4fd3-8e08-e469469cce93\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" Jun 09 11:59:38.118472 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.118433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e064597-2eef-4676-9a3e-ff5e6966c41b-data-volume\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.118615 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.118596 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84c6dfb985-66pc2"] Jun 09 11:59:38.219059 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e064597-2eef-4676-9a3e-ff5e6966c41b-crio-socket\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.219059 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61e47b6d-f4a8-43fc-b747-e018c80286d1-bound-sa-token\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.219256 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61e47b6d-f4a8-43fc-b747-e018c80286d1-image-registry-private-configuration\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.219256 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61e47b6d-f4a8-43fc-b747-e018c80286d1-registry-certificates\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.219256 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e064597-2eef-4676-9a3e-ff5e6966c41b-crio-socket\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.219256 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e064597-2eef-4676-9a3e-ff5e6966c41b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.219256 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61e47b6d-f4a8-43fc-b747-e018c80286d1-ca-trust-extracted\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.219406 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61e47b6d-f4a8-43fc-b747-e018c80286d1-trusted-ca\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.219406 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219287 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61e47b6d-f4a8-43fc-b747-e018c80286d1-installation-pull-secrets\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.219406 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg82g\" (UniqueName: \"kubernetes.io/projected/61e47b6d-f4a8-43fc-b747-e018c80286d1-kube-api-access-wg82g\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.219406 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bf13fd1-b972-4fd3-8e08-e469469cce93-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j6cm7\" (UID: \"3bf13fd1-b972-4fd3-8e08-e469469cce93\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" Jun 09 11:59:38.219406 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e064597-2eef-4676-9a3e-ff5e6966c41b-data-volume\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.219549 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e47b6d-f4a8-43fc-b747-e018c80286d1-registry-tls\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.219549 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e064597-2eef-4676-9a3e-ff5e6966c41b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.219549 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6pm\" (UniqueName: \"kubernetes.io/projected/9e064597-2eef-4676-9a3e-ff5e6966c41b-kube-api-access-wd6pm\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.219735 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.219717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e064597-2eef-4676-9a3e-ff5e6966c41b-data-volume\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.220054 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.220038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e064597-2eef-4676-9a3e-ff5e6966c41b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.222087 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.222057 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e064597-2eef-4676-9a3e-ff5e6966c41b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.222273 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.222251 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bf13fd1-b972-4fd3-8e08-e469469cce93-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j6cm7\" (UID: \"3bf13fd1-b972-4fd3-8e08-e469469cce93\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" Jun 09 11:59:38.227934 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.227915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd6pm\" (UniqueName: \"kubernetes.io/projected/9e064597-2eef-4676-9a3e-ff5e6966c41b-kube-api-access-wd6pm\") pod \"insights-runtime-extractor-b2n79\" (UID: \"9e064597-2eef-4676-9a3e-ff5e6966c41b\") " pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.320538 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.320456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61e47b6d-f4a8-43fc-b747-e018c80286d1-ca-trust-extracted\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.320538 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.320516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61e47b6d-f4a8-43fc-b747-e018c80286d1-trusted-ca\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.320781 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.320541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61e47b6d-f4a8-43fc-b747-e018c80286d1-installation-pull-secrets\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.320781 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.320567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg82g\" (UniqueName: \"kubernetes.io/projected/61e47b6d-f4a8-43fc-b747-e018c80286d1-kube-api-access-wg82g\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.320781 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.320598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e47b6d-f4a8-43fc-b747-e018c80286d1-registry-tls\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.320781 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.320693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61e47b6d-f4a8-43fc-b747-e018c80286d1-bound-sa-token\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.321009 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.320889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61e47b6d-f4a8-43fc-b747-e018c80286d1-ca-trust-extracted\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.321492 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.321233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61e47b6d-f4a8-43fc-b747-e018c80286d1-image-registry-private-configuration\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.321492 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.321293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61e47b6d-f4a8-43fc-b747-e018c80286d1-registry-certificates\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.321661 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.321647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61e47b6d-f4a8-43fc-b747-e018c80286d1-trusted-ca\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.322076 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.322054 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61e47b6d-f4a8-43fc-b747-e018c80286d1-registry-certificates\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.323261 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.323243 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61e47b6d-f4a8-43fc-b747-e018c80286d1-installation-pull-secrets\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.323554 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.323534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e47b6d-f4a8-43fc-b747-e018c80286d1-registry-tls\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.323836 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.323800 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61e47b6d-f4a8-43fc-b747-e018c80286d1-image-registry-private-configuration\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.354245 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.331760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61e47b6d-f4a8-43fc-b747-e018c80286d1-bound-sa-token\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.354830 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.354793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg82g\" (UniqueName: \"kubernetes.io/projected/61e47b6d-f4a8-43fc-b747-e018c80286d1-kube-api-access-wg82g\") pod \"image-registry-84c6dfb985-66pc2\" (UID: \"61e47b6d-f4a8-43fc-b747-e018c80286d1\") " pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.354948 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.354936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" Jun 09 11:59:38.365053 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.365030 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b2n79" Jun 09 11:59:38.411332 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.411294 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:38.504601 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.504562 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7"] Jun 09 11:59:38.510106 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:38.510074 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf13fd1_b972_4fd3_8e08_e469469cce93.slice/crio-bef2eb3dcbc3faf030ee5a25dbe6fac3d644f726642c14b467af8a508b1c7ec5 WatchSource:0}: Error finding container bef2eb3dcbc3faf030ee5a25dbe6fac3d644f726642c14b467af8a508b1c7ec5: Status 404 returned error can't find the container with id bef2eb3dcbc3faf030ee5a25dbe6fac3d644f726642c14b467af8a508b1c7ec5 Jun 09 11:59:38.523994 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.523957 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b2n79"] Jun 09 11:59:38.527264 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:38.527239 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e064597_2eef_4676_9a3e_ff5e6966c41b.slice/crio-28e2f9f193f3c16beecec3974adfd4eee8c95b5674ff30248b666b067b7d72ba WatchSource:0}: Error finding container 28e2f9f193f3c16beecec3974adfd4eee8c95b5674ff30248b666b067b7d72ba: Status 404 returned error can't find the container with id 28e2f9f193f3c16beecec3974adfd4eee8c95b5674ff30248b666b067b7d72ba Jun 09 11:59:38.561064 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:38.561001 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84c6dfb985-66pc2"] Jun 09 11:59:38.564552 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:38.564519 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e47b6d_f4a8_43fc_b747_e018c80286d1.slice/crio-f65e3c2c6f440ea2ee90f034a3d053f2296a8fa1817588440a2dca5e6182717a WatchSource:0}: Error finding container f65e3c2c6f440ea2ee90f034a3d053f2296a8fa1817588440a2dca5e6182717a: Status 404 returned error can't find the container with id f65e3c2c6f440ea2ee90f034a3d053f2296a8fa1817588440a2dca5e6182717a Jun 09 11:59:39.079073 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.079048 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:39.079557 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.079099 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 11:59:39.079557 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.079423 2562 scope.go:117] "RemoveContainer" containerID="5e1128e4a3ce585f4ba522b15209feec149e4eebb8cf86eabafe8311994d73b7" Jun 09 11:59:39.079736 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:39.079574 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-8rmgp_openshift-console-operator(baa81a0d-4a24-42f3-a8b3-06bdaaa795df)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" podUID="baa81a0d-4a24-42f3-a8b3-06bdaaa795df" Jun 09 11:59:39.323936 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.323841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" event={"ID":"61e47b6d-f4a8-43fc-b747-e018c80286d1","Type":"ContainerStarted","Data":"899d36b1ae37c2b0d6f0367d07ad8ffa943ce388b29f00df82146b8c5671584a"} Jun 09 11:59:39.323936 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.323898 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" event={"ID":"61e47b6d-f4a8-43fc-b747-e018c80286d1","Type":"ContainerStarted","Data":"f65e3c2c6f440ea2ee90f034a3d053f2296a8fa1817588440a2dca5e6182717a"} Jun 09 11:59:39.324160 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.323956 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 11:59:39.325214 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.325191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" event={"ID":"3bf13fd1-b972-4fd3-8e08-e469469cce93","Type":"ContainerStarted","Data":"bef2eb3dcbc3faf030ee5a25dbe6fac3d644f726642c14b467af8a508b1c7ec5"} Jun 09 11:59:39.327162 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.327139 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2n79" event={"ID":"9e064597-2eef-4676-9a3e-ff5e6966c41b","Type":"ContainerStarted","Data":"a79606ddbadf34a510732f152bac3ad32035f0ee3f71d96c683c43b8de3d1221"} Jun 09 11:59:39.327271 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.327179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2n79" event={"ID":"9e064597-2eef-4676-9a3e-ff5e6966c41b","Type":"ContainerStarted","Data":"e38fa0bf3c4c1185a49e27b2fa81512383aacff8027fd002c05ca4979c360644"} Jun 09 11:59:39.327271 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.327208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2n79" event={"ID":"9e064597-2eef-4676-9a3e-ff5e6966c41b","Type":"ContainerStarted","Data":"28e2f9f193f3c16beecec3974adfd4eee8c95b5674ff30248b666b067b7d72ba"} Jun 09 11:59:39.345033 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:39.344976 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" podStartSLOduration=1.344959974 podStartE2EDuration="1.344959974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:39.34410045 +0000 UTC m=+264.216363467" watchObservedRunningTime="2026-06-09 11:59:39.344959974 +0000 UTC m=+264.217222940" Jun 09 11:59:40.332946 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:40.332912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" event={"ID":"3bf13fd1-b972-4fd3-8e08-e469469cce93","Type":"ContainerStarted","Data":"bfc380538fdceea860efe84961c068bca9240622811a14aa1a9e7cf7384d29b1"} Jun 09 11:59:40.333397 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:40.332994 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" Jun 09 11:59:40.338535 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:40.338500 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" Jun 09 11:59:40.348677 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:40.348638 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j6cm7" podStartSLOduration=1.3243889389999999 podStartE2EDuration="2.348623242s" totalImagesPullingTime="1.024234303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:40.347587874 +0000 UTC m=+265.219850864" watchObservedRunningTime="2026-06-09 11:59:40.348623242 +0000 UTC m=+265.220886231" Jun 09 11:59:41.337732 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:41.337694 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2n79" event={"ID":"9e064597-2eef-4676-9a3e-ff5e6966c41b","Type":"ContainerStarted","Data":"038fa47f72c37712d140c80574c823727b511aa51b8487a1e6a5579ed3939331"} Jun 09 11:59:41.354883 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:41.354837 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b2n79" podStartSLOduration=1.482313421 podStartE2EDuration="3.354804095s" totalImagesPullingTime="1.872490674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:59:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:41.354187151 +0000 UTC m=+266.226450139" watchObservedRunningTime="2026-06-09 11:59:41.354804095 +0000 UTC m=+266.227067122" Jun 09 11:59:45.594030 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.593993 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wzqpk"] Jun 09 11:59:45.630028 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.629996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.632356 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.632332 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 11:59:45.632483 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.632374 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 11:59:45.632483 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.632415 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 11:59:45.633101 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.633087 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 11:59:45.633386 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.633373 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 11:59:45.633490 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.633467 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 11:59:45.633560 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.633472 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5k8wf\"" Jun 09 11:59:45.782056 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.782017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.782056 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.782060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-textfile\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.782274 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.782084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.782274 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.782141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d726bf68-e882-4836-8b7b-295c79838dc7-sys\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.782274 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.782183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns4zt\" (UniqueName: \"kubernetes.io/projected/d726bf68-e882-4836-8b7b-295c79838dc7-kube-api-access-ns4zt\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.782274 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.782203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d726bf68-e882-4836-8b7b-295c79838dc7-root\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.782274 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.782219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d726bf68-e882-4836-8b7b-295c79838dc7-metrics-client-ca\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.782449 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.782278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-wtmp\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.782449 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.782314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-tls\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.883717 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-textfile\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.883717 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.883717 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d726bf68-e882-4836-8b7b-295c79838dc7-sys\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns4zt\" (UniqueName: \"kubernetes.io/projected/d726bf68-e882-4836-8b7b-295c79838dc7-kube-api-access-ns4zt\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d726bf68-e882-4836-8b7b-295c79838dc7-root\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d726bf68-e882-4836-8b7b-295c79838dc7-metrics-client-ca\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883854 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d726bf68-e882-4836-8b7b-295c79838dc7-sys\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d726bf68-e882-4836-8b7b-295c79838dc7-root\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-wtmp\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-tls\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.883985 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-wtmp\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884034 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.884023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-textfile\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884437 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.884038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884437 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:45.884084 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 11:59:45.884437 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:45.884162 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-tls podName:d726bf68-e882-4836-8b7b-295c79838dc7 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:46.384141412 +0000 UTC m=+271.256404393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-tls") pod "node-exporter-wzqpk" (UID: "d726bf68-e882-4836-8b7b-295c79838dc7") : secret "node-exporter-tls" not found Jun 09 11:59:45.884437 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.884263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.884437 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.884344 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d726bf68-e882-4836-8b7b-295c79838dc7-metrics-client-ca\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.886138 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.886121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:45.892120 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:45.892095 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns4zt\" (UniqueName: \"kubernetes.io/projected/d726bf68-e882-4836-8b7b-295c79838dc7-kube-api-access-ns4zt\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:46.387580 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:46.387550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-tls\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:46.387740 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:46.387661 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 11:59:46.387740 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:46.387713 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-tls podName:d726bf68-e882-4836-8b7b-295c79838dc7 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:47.387698345 +0000 UTC m=+272.259961312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-tls") pod "node-exporter-wzqpk" (UID: "d726bf68-e882-4836-8b7b-295c79838dc7") : secret "node-exporter-tls" not found Jun 09 11:59:47.395834 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.395791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-tls\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:47.397945 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.397919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d726bf68-e882-4836-8b7b-295c79838dc7-node-exporter-tls\") pod \"node-exporter-wzqpk\" (UID: \"d726bf68-e882-4836-8b7b-295c79838dc7\") " pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:47.439279 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.439255 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wzqpk" Jun 09 11:59:47.449834 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:47.449794 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd726bf68_e882_4836_8b7b_295c79838dc7.slice/crio-2a639b53987c5c60186d8900b51b9a70a16240d966dac4fdfff164f7a0d07787 WatchSource:0}: Error finding container 2a639b53987c5c60186d8900b51b9a70a16240d966dac4fdfff164f7a0d07787: Status 404 returned error can't find the container with id 2a639b53987c5c60186d8900b51b9a70a16240d966dac4fdfff164f7a0d07787 Jun 09 11:59:47.582040 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.582010 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f65758cd-j9t2n"] Jun 09 11:59:47.584897 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.584881 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.590781 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.590760 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xj4vz\"" Jun 09 11:59:47.591179 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.590901 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 11:59:47.591249 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.591191 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 11:59:47.591605 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.591585 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 11:59:47.591711 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.591608 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 11:59:47.591711 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.591625 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5088edritlrib\"" Jun 09 11:59:47.592532 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.592517 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 11:59:47.598744 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.598724 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f65758cd-j9t2n"] Jun 09 11:59:47.698111 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.698086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.698230 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.698125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.698230 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.698165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.698230 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.698188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29c35eb4-861e-4468-9ae5-a08d9741464e-metrics-client-ca\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.698230 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.698208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-grpc-tls\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.698360 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.698240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.698360 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.698277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx9z6\" (UniqueName: \"kubernetes.io/projected/29c35eb4-861e-4468-9ae5-a08d9741464e-kube-api-access-dx9z6\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.698360 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.698306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-tls\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.798793 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.798766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-tls\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.798931 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.798796 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.798931 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.798838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.798931 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.798870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.798931 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.798889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29c35eb4-861e-4468-9ae5-a08d9741464e-metrics-client-ca\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.798931 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.798907 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-grpc-tls\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.799130 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.799067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.799181 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.799156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx9z6\" (UniqueName: \"kubernetes.io/projected/29c35eb4-861e-4468-9ae5-a08d9741464e-kube-api-access-dx9z6\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.799717 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.799694 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29c35eb4-861e-4468-9ae5-a08d9741464e-metrics-client-ca\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.801449 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.801423 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.801544 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.801432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-grpc-tls\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.801622 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.801602 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-tls\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.801707 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.801690 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.801835 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.801800 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.802201 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.802178 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29c35eb4-861e-4468-9ae5-a08d9741464e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.806872 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.806852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx9z6\" (UniqueName: \"kubernetes.io/projected/29c35eb4-861e-4468-9ae5-a08d9741464e-kube-api-access-dx9z6\") pod \"thanos-querier-6f65758cd-j9t2n\" (UID: \"29c35eb4-861e-4468-9ae5-a08d9741464e\") " pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:47.893758 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:47.893724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:48.041128 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:48.041084 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f65758cd-j9t2n"] Jun 09 11:59:48.043913 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:48.043876 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c35eb4_861e_4468_9ae5_a08d9741464e.slice/crio-50174f6b213e19248531dd7bb2c542aa9b1522d2ba004ba479a99781ba54c08c WatchSource:0}: Error finding container 50174f6b213e19248531dd7bb2c542aa9b1522d2ba004ba479a99781ba54c08c: Status 404 returned error can't find the container with id 50174f6b213e19248531dd7bb2c542aa9b1522d2ba004ba479a99781ba54c08c Jun 09 11:59:48.362682 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:48.362651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wzqpk" event={"ID":"d726bf68-e882-4836-8b7b-295c79838dc7","Type":"ContainerStarted","Data":"131ed37845f5e17a18fe66396ecc5ef96d45674d001ca32f6438b065d7314b52"} Jun 09 11:59:48.362828 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:48.362709 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wzqpk" event={"ID":"d726bf68-e882-4836-8b7b-295c79838dc7","Type":"ContainerStarted","Data":"2a639b53987c5c60186d8900b51b9a70a16240d966dac4fdfff164f7a0d07787"} Jun 09 11:59:48.363911 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:48.363879 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" event={"ID":"29c35eb4-861e-4468-9ae5-a08d9741464e","Type":"ContainerStarted","Data":"50174f6b213e19248531dd7bb2c542aa9b1522d2ba004ba479a99781ba54c08c"} Jun 09 11:59:49.368653 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.368618 2562 generic.go:356] "Generic (PLEG): container finished" podID="d726bf68-e882-4836-8b7b-295c79838dc7" containerID="131ed37845f5e17a18fe66396ecc5ef96d45674d001ca32f6438b065d7314b52" exitCode=0 Jun 09 11:59:49.369153 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.368697 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wzqpk" event={"ID":"d726bf68-e882-4836-8b7b-295c79838dc7","Type":"ContainerDied","Data":"131ed37845f5e17a18fe66396ecc5ef96d45674d001ca32f6438b065d7314b52"} Jun 09 11:59:49.901454 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.901427 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-844fd5f967-tx792"] Jun 09 11:59:49.903986 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.903965 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:49.907304 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.907277 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 11:59:49.907426 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.907348 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 11:59:49.907830 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.907548 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-d5sps\"" Jun 09 11:59:49.907830 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.907600 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a07dah4rvk6e5\"" Jun 09 11:59:49.907830 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.907649 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 11:59:49.907830 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.907548 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 11:59:49.916148 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:49.916130 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-844fd5f967-tx792"] Jun 09 11:59:50.021632 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.021606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb111204-25a3-43dd-afcd-24de9b132d0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.021723 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.021644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb111204-25a3-43dd-afcd-24de9b132d0f-secret-metrics-server-client-certs\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.021723 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.021661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb111204-25a3-43dd-afcd-24de9b132d0f-metrics-server-audit-profiles\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.021850 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.021762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb111204-25a3-43dd-afcd-24de9b132d0f-audit-log\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.021850 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.021800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb111204-25a3-43dd-afcd-24de9b132d0f-client-ca-bundle\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.021959 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.021878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf77d\" (UniqueName: \"kubernetes.io/projected/eb111204-25a3-43dd-afcd-24de9b132d0f-kube-api-access-zf77d\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.021959 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.021901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb111204-25a3-43dd-afcd-24de9b132d0f-secret-metrics-server-tls\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.123044 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.123022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf77d\" (UniqueName: \"kubernetes.io/projected/eb111204-25a3-43dd-afcd-24de9b132d0f-kube-api-access-zf77d\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.123150 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.123056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb111204-25a3-43dd-afcd-24de9b132d0f-secret-metrics-server-tls\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.123150 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.123092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb111204-25a3-43dd-afcd-24de9b132d0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.123150 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.123119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb111204-25a3-43dd-afcd-24de9b132d0f-secret-metrics-server-client-certs\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.123150 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.123145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb111204-25a3-43dd-afcd-24de9b132d0f-metrics-server-audit-profiles\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.123364 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.123201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb111204-25a3-43dd-afcd-24de9b132d0f-audit-log\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.123364 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.123227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb111204-25a3-43dd-afcd-24de9b132d0f-client-ca-bundle\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.124136 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.123767 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb111204-25a3-43dd-afcd-24de9b132d0f-audit-log\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.124136 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.124052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb111204-25a3-43dd-afcd-24de9b132d0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.124366 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.124346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb111204-25a3-43dd-afcd-24de9b132d0f-metrics-server-audit-profiles\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.125546 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.125521 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb111204-25a3-43dd-afcd-24de9b132d0f-client-ca-bundle\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.125642 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.125588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb111204-25a3-43dd-afcd-24de9b132d0f-secret-metrics-server-client-certs\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.125751 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.125734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb111204-25a3-43dd-afcd-24de9b132d0f-secret-metrics-server-tls\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.131021 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.130997 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf77d\" (UniqueName: \"kubernetes.io/projected/eb111204-25a3-43dd-afcd-24de9b132d0f-kube-api-access-zf77d\") pod \"metrics-server-844fd5f967-tx792\" (UID: \"eb111204-25a3-43dd-afcd-24de9b132d0f\") " pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.212949 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.212927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 11:59:50.343772 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.343743 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-844fd5f967-tx792"] Jun 09 11:59:50.347400 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:50.347377 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb111204_25a3_43dd_afcd_24de9b132d0f.slice/crio-fbf52fa0c1c4ca0dab6429f6bcd2f3383d511b462976e67ed507725faef864d0 WatchSource:0}: Error finding container fbf52fa0c1c4ca0dab6429f6bcd2f3383d511b462976e67ed507725faef864d0: Status 404 returned error can't find the container with id fbf52fa0c1c4ca0dab6429f6bcd2f3383d511b462976e67ed507725faef864d0 Jun 09 11:59:50.354675 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.354652 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk"] Jun 09 11:59:50.357575 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.357558 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:50.359746 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.359725 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ztvdx\"" Jun 09 11:59:50.360030 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.360015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 11:59:50.374349 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.374329 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk"] Jun 09 11:59:50.374728 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.374709 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" event={"ID":"29c35eb4-861e-4468-9ae5-a08d9741464e","Type":"ContainerStarted","Data":"865f3df05628c05d3096c4ffc7e1fae7894012948b11567d33d60aebd5b2be13"} Jun 09 11:59:50.374790 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.374774 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" event={"ID":"29c35eb4-861e-4468-9ae5-a08d9741464e","Type":"ContainerStarted","Data":"e15857658c0d0c8a46ce566dcbaeb41cd9df83132cb487d632cf57d601410eec"} Jun 09 11:59:50.374860 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.374842 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" event={"ID":"29c35eb4-861e-4468-9ae5-a08d9741464e","Type":"ContainerStarted","Data":"1efa2eaf1295a5c4060a1fff9d080272700c2f1cbade2f14ba54bb72f5e475a2"} Jun 09 11:59:50.376936 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.376915 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wzqpk" event={"ID":"d726bf68-e882-4836-8b7b-295c79838dc7","Type":"ContainerStarted","Data":"534e3bc10fd2519b59ae0036d75cd088f397433de6cf37df095ee38abd731ca0"} Jun 09 11:59:50.377031 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.376958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wzqpk" event={"ID":"d726bf68-e882-4836-8b7b-295c79838dc7","Type":"ContainerStarted","Data":"990fe7f11ecccc4d263fbd4f19ea2d97e4e867776446541a6967e679fef16ce9"} Jun 09 11:59:50.378103 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.378085 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-844fd5f967-tx792" event={"ID":"eb111204-25a3-43dd-afcd-24de9b132d0f","Type":"ContainerStarted","Data":"fbf52fa0c1c4ca0dab6429f6bcd2f3383d511b462976e67ed507725faef864d0"} Jun 09 11:59:50.428166 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.428132 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wzqpk" podStartSLOduration=4.530518195 podStartE2EDuration="5.428119724s" totalImagesPullingTime="830.432193ms" totalInitContainerRuntime="67.169336ms" isStatefulPod=true podCreationTimestamp="2026-06-09 11:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:50.426189857 +0000 UTC m=+275.298452842" watchObservedRunningTime="2026-06-09 11:59:50.428119724 +0000 UTC m=+275.300382711" Jun 09 11:59:50.525825 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.525754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25bc5e14-b906-44eb-bb4e-ac2835f9df4d-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-v5lrk\" (UID: \"25bc5e14-b906-44eb-bb4e-ac2835f9df4d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:50.525825 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.525794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4wdv\" (UniqueName: \"kubernetes.io/projected/25bc5e14-b906-44eb-bb4e-ac2835f9df4d-kube-api-access-c4wdv\") pod \"monitoring-plugin-76b68cc874-v5lrk\" (UID: \"25bc5e14-b906-44eb-bb4e-ac2835f9df4d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:50.627293 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.627261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25bc5e14-b906-44eb-bb4e-ac2835f9df4d-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-v5lrk\" (UID: \"25bc5e14-b906-44eb-bb4e-ac2835f9df4d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:50.627428 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.627311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4wdv\" (UniqueName: \"kubernetes.io/projected/25bc5e14-b906-44eb-bb4e-ac2835f9df4d-kube-api-access-c4wdv\") pod \"monitoring-plugin-76b68cc874-v5lrk\" (UID: \"25bc5e14-b906-44eb-bb4e-ac2835f9df4d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:50.629803 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.629784 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25bc5e14-b906-44eb-bb4e-ac2835f9df4d-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-v5lrk\" (UID: \"25bc5e14-b906-44eb-bb4e-ac2835f9df4d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:50.640762 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.640739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4wdv\" (UniqueName: \"kubernetes.io/projected/25bc5e14-b906-44eb-bb4e-ac2835f9df4d-kube-api-access-c4wdv\") pod \"monitoring-plugin-76b68cc874-v5lrk\" (UID: \"25bc5e14-b906-44eb-bb4e-ac2835f9df4d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:50.667434 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.667411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:50.805248 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:50.805172 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk"] Jun 09 11:59:50.868310 ip-10-0-141-91 kubenswrapper[2562]: W0609 11:59:50.868275 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bc5e14_b906_44eb_bb4e_ac2835f9df4d.slice/crio-73f69ea57f54fa2b96307c4e3a1fc1c612551b97895331391e3ff49d1c62b326 WatchSource:0}: Error finding container 73f69ea57f54fa2b96307c4e3a1fc1c612551b97895331391e3ff49d1c62b326: Status 404 returned error can't find the container with id 73f69ea57f54fa2b96307c4e3a1fc1c612551b97895331391e3ff49d1c62b326 Jun 09 11:59:51.386462 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:51.386359 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" event={"ID":"29c35eb4-861e-4468-9ae5-a08d9741464e","Type":"ContainerStarted","Data":"8ae4bf4e528790f97f67efae47f2a233a23cc6944c9d4910e37b909e9a95da6f"} Jun 09 11:59:51.386462 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:51.386446 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" event={"ID":"29c35eb4-861e-4468-9ae5-a08d9741464e","Type":"ContainerStarted","Data":"6eae9dda88852b1c29f5466b167bb8f5a43bec9953fdeba2d07051c55501db8f"} Jun 09 11:59:51.387027 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:51.386497 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" event={"ID":"29c35eb4-861e-4468-9ae5-a08d9741464e","Type":"ContainerStarted","Data":"5b558004e5d1fcecc2e55057d45402ccf596f60e4e1d6d19fcaaac963fab1634"} Jun 09 11:59:51.387027 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:51.386540 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:51.387743 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:51.387683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" event={"ID":"25bc5e14-b906-44eb-bb4e-ac2835f9df4d","Type":"ContainerStarted","Data":"73f69ea57f54fa2b96307c4e3a1fc1c612551b97895331391e3ff49d1c62b326"} Jun 09 11:59:51.414560 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:51.414505 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" podStartSLOduration=1.712327806 podStartE2EDuration="4.414485381s" totalImagesPullingTime="2.702157575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:51.414102471 +0000 UTC m=+276.286365460" watchObservedRunningTime="2026-06-09 11:59:51.414485381 +0000 UTC m=+276.286748370" Jun 09 11:59:52.392670 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:52.392636 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-844fd5f967-tx792" event={"ID":"eb111204-25a3-43dd-afcd-24de9b132d0f","Type":"ContainerStarted","Data":"3a1b7448ea4a5ef81524232c38f8625a4d2f0a61a162de7fd2ab679a72c05b23"} Jun 09 11:59:52.394229 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:52.394202 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" event={"ID":"25bc5e14-b906-44eb-bb4e-ac2835f9df4d","Type":"ContainerStarted","Data":"42b4ae44da59533ca8ddaf5c0a97c31edaed1773bdeac0e70414398e1e6b2c0d"} Jun 09 11:59:52.394482 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:52.394463 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:52.399453 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:52.399435 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" Jun 09 11:59:52.418597 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:52.418554 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-844fd5f967-tx792" podStartSLOduration=1.582824627 podStartE2EDuration="3.418539919s" totalImagesPullingTime="1.835715292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:52.416459205 +0000 UTC m=+277.288722192" watchObservedRunningTime="2026-06-09 11:59:52.418539919 +0000 UTC m=+277.290802908" Jun 09 11:59:52.440286 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:52.440031 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-v5lrk" podStartSLOduration=1.122630786 podStartE2EDuration="2.440013814s" totalImagesPullingTime="1.317383028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:52.439192092 +0000 UTC m=+277.311455085" watchObservedRunningTime="2026-06-09 11:59:52.440013814 +0000 UTC m=+277.312276807" Jun 09 11:59:53.562659 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:53.562631 2562 scope.go:117] "RemoveContainer" containerID="5e1128e4a3ce585f4ba522b15209feec149e4eebb8cf86eabafe8311994d73b7" Jun 09 11:59:53.563028 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:53.562801 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-8rmgp_openshift-console-operator(baa81a0d-4a24-42f3-a8b3-06bdaaa795df)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" podUID="baa81a0d-4a24-42f3-a8b3-06bdaaa795df" Jun 09 11:59:57.023488 ip-10-0-141-91 kubenswrapper[2562]: E0609 11:59:57.023445 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-glnpb" podUID="7a9fb9ea-d453-4b7a-9987-07911094c803" Jun 09 11:59:57.400381 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:57.400310 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f65758cd-j9t2n" Jun 09 11:59:57.414180 ip-10-0-141-91 kubenswrapper[2562]: I0609 11:59:57.414161 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-glnpb" Jun 09 12:00:00.338290 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:00.338258 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84c6dfb985-66pc2" Jun 09 12:00:00.898561 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:00.898527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 12:00:00.900867 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:00.900841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9fb9ea-d453-4b7a-9987-07911094c803-metrics-tls\") pod \"dns-default-glnpb\" (UID: \"7a9fb9ea-d453-4b7a-9987-07911094c803\") " pod="openshift-dns/dns-default-glnpb" Jun 09 12:00:01.017557 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:01.017531 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xs666\"" Jun 09 12:00:01.025068 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:01.025043 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-glnpb" Jun 09 12:00:01.149429 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:01.149409 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-glnpb"] Jun 09 12:00:01.151727 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:00:01.151706 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9fb9ea_d453_4b7a_9987_07911094c803.slice/crio-738dd6b08f3611132d975039a2b41bda8e81eb4b5d5291568912ef07706618d3 WatchSource:0}: Error finding container 738dd6b08f3611132d975039a2b41bda8e81eb4b5d5291568912ef07706618d3: Status 404 returned error can't find the container with id 738dd6b08f3611132d975039a2b41bda8e81eb4b5d5291568912ef07706618d3 Jun 09 12:00:01.429297 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:01.429257 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-glnpb" event={"ID":"7a9fb9ea-d453-4b7a-9987-07911094c803","Type":"ContainerStarted","Data":"738dd6b08f3611132d975039a2b41bda8e81eb4b5d5291568912ef07706618d3"} Jun 09 12:00:03.439088 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:03.439056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-glnpb" event={"ID":"7a9fb9ea-d453-4b7a-9987-07911094c803","Type":"ContainerStarted","Data":"9857457f31e570a837c7439195edbd97518901d563124e38b01b11d4a81e96cf"} Jun 09 12:00:03.439434 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:03.439105 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-glnpb" event={"ID":"7a9fb9ea-d453-4b7a-9987-07911094c803","Type":"ContainerStarted","Data":"ba2a520705d5e6ebf48fe1e20b5bd346aefdd413cf9a499442d159fd8b19906e"} Jun 09 12:00:03.439434 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:03.439136 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-glnpb" Jun 09 12:00:03.456164 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:03.456122 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-glnpb" podStartSLOduration=251.796420677 podStartE2EDuration="4m13.456103957s" totalImagesPullingTime="1.65968328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:03.455364977 +0000 UTC m=+288.327627962" watchObservedRunningTime="2026-06-09 12:00:03.456103957 +0000 UTC m=+288.328366945" Jun 09 12:00:06.562966 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:06.562935 2562 scope.go:117] "RemoveContainer" containerID="5e1128e4a3ce585f4ba522b15209feec149e4eebb8cf86eabafe8311994d73b7" Jun 09 12:00:07.410263 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.410224 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-n4rdw"] Jun 09 12:00:07.412728 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.412708 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-n4rdw" Jun 09 12:00:07.415174 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.415154 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 12:00:07.415174 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.415164 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vnbmq\"" Jun 09 12:00:07.415338 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.415209 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 12:00:07.422627 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.422609 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-n4rdw"] Jun 09 12:00:07.444370 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.444337 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdw9w\" (UniqueName: \"kubernetes.io/projected/85b81937-25fe-4a9d-ad8f-84371ce15b6d-kube-api-access-rdw9w\") pod \"downloads-6657875f97-n4rdw\" (UID: \"85b81937-25fe-4a9d-ad8f-84371ce15b6d\") " pod="openshift-console/downloads-6657875f97-n4rdw" Jun 09 12:00:07.454971 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.454954 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:00:07.455059 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.455044 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" event={"ID":"baa81a0d-4a24-42f3-a8b3-06bdaaa795df","Type":"ContainerStarted","Data":"faac4f68463ad599348b3f35664df04f3af93501f858dac5fd22e7dbfdb1d8ae"} Jun 09 12:00:07.455325 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.455308 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 12:00:07.460028 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.460009 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" Jun 09 12:00:07.475668 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.475626 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-8rmgp" podStartSLOduration=57.336841973 podStartE2EDuration="59.475603235s" totalImagesPullingTime="2.138761262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:07.475314268 +0000 UTC m=+292.347577278" watchObservedRunningTime="2026-06-09 12:00:07.475603235 +0000 UTC m=+292.347866225" Jun 09 12:00:07.544965 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.544936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdw9w\" (UniqueName: \"kubernetes.io/projected/85b81937-25fe-4a9d-ad8f-84371ce15b6d-kube-api-access-rdw9w\") pod \"downloads-6657875f97-n4rdw\" (UID: \"85b81937-25fe-4a9d-ad8f-84371ce15b6d\") " pod="openshift-console/downloads-6657875f97-n4rdw" Jun 09 12:00:07.553500 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.553477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdw9w\" (UniqueName: \"kubernetes.io/projected/85b81937-25fe-4a9d-ad8f-84371ce15b6d-kube-api-access-rdw9w\") pod \"downloads-6657875f97-n4rdw\" (UID: \"85b81937-25fe-4a9d-ad8f-84371ce15b6d\") " pod="openshift-console/downloads-6657875f97-n4rdw" Jun 09 12:00:07.721921 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.721846 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-n4rdw" Jun 09 12:00:07.845632 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:07.845605 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-n4rdw"] Jun 09 12:00:07.848833 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:00:07.848789 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b81937_25fe_4a9d_ad8f_84371ce15b6d.slice/crio-f0e7ef71569cb713518d6398926f2981fe34b23c43f72a2cdcbbaa8e354a1b62 WatchSource:0}: Error finding container f0e7ef71569cb713518d6398926f2981fe34b23c43f72a2cdcbbaa8e354a1b62: Status 404 returned error can't find the container with id f0e7ef71569cb713518d6398926f2981fe34b23c43f72a2cdcbbaa8e354a1b62 Jun 09 12:00:08.459714 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:08.459676 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-n4rdw" event={"ID":"85b81937-25fe-4a9d-ad8f-84371ce15b6d","Type":"ContainerStarted","Data":"f0e7ef71569cb713518d6398926f2981fe34b23c43f72a2cdcbbaa8e354a1b62"} Jun 09 12:00:10.213507 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:10.213464 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 12:00:10.213966 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:10.213557 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 12:00:13.445570 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:13.445544 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-glnpb" Jun 09 12:00:15.526806 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:15.526774 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:00:15.527675 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:15.527647 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:00:15.540871 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:15.540848 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 12:00:18.128948 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.128913 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6798dfdf99-fkk5j"] Jun 09 12:00:18.133367 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.133345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.136834 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.136798 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 12:00:18.137019 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.136998 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 12:00:18.137130 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.137041 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 12:00:18.137130 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.137055 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 12:00:18.137130 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.137080 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 12:00:18.137292 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.137146 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kw47k\"" Jun 09 12:00:18.142497 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.142472 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6798dfdf99-fkk5j"] Jun 09 12:00:18.245635 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.245589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-serving-cert\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.245833 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.245654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-oauth-serving-cert\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.245833 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.245730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89sjt\" (UniqueName: \"kubernetes.io/projected/79ebb24c-5389-4392-b591-c6a10d694ed9-kube-api-access-89sjt\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.245833 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.245799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-console-config\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.245981 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.245844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-service-ca\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.245981 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.245921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-oauth-config\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.346597 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.346561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-serving-cert\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.346776 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.346622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-oauth-serving-cert\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.346776 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.346651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89sjt\" (UniqueName: \"kubernetes.io/projected/79ebb24c-5389-4392-b591-c6a10d694ed9-kube-api-access-89sjt\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.346776 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.346688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-console-config\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.346776 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.346709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-service-ca\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.346776 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.346753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-oauth-config\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.347560 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.347532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-console-config\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.347690 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.347532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-oauth-serving-cert\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.347690 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.347593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-service-ca\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.349466 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.349415 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-oauth-config\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.349568 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.349549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-serving-cert\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.355250 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.355221 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89sjt\" (UniqueName: \"kubernetes.io/projected/79ebb24c-5389-4392-b591-c6a10d694ed9-kube-api-access-89sjt\") pod \"console-6798dfdf99-fkk5j\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:18.446145 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:18.446113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:23.476930 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:23.476866 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6798dfdf99-fkk5j"] Jun 09 12:00:23.487900 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:00:23.487873 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ebb24c_5389_4392_b591_c6a10d694ed9.slice/crio-c65cf6a49c633f6ba2942a652d900eb3145f25ba4e96d5da4f7867671c8b9c15 WatchSource:0}: Error finding container c65cf6a49c633f6ba2942a652d900eb3145f25ba4e96d5da4f7867671c8b9c15: Status 404 returned error can't find the container with id c65cf6a49c633f6ba2942a652d900eb3145f25ba4e96d5da4f7867671c8b9c15 Jun 09 12:00:23.489935 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:23.489916 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:00:23.529192 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:23.529168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6798dfdf99-fkk5j" event={"ID":"79ebb24c-5389-4392-b591-c6a10d694ed9","Type":"ContainerStarted","Data":"c65cf6a49c633f6ba2942a652d900eb3145f25ba4e96d5da4f7867671c8b9c15"} Jun 09 12:00:24.536465 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:24.536419 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-n4rdw" event={"ID":"85b81937-25fe-4a9d-ad8f-84371ce15b6d","Type":"ContainerStarted","Data":"cc0165d77b768361f265de7e9e4373f9d472cc5f4400399e497402c302e029df"} Jun 09 12:00:24.536974 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:24.536868 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-n4rdw" Jun 09 12:00:24.549658 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:24.549629 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-n4rdw" Jun 09 12:00:24.574542 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:24.574488 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-n4rdw" podStartSLOduration=1.9793310210000001 podStartE2EDuration="17.574467942s" totalImagesPullingTime="15.595136921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:24.55340468 +0000 UTC m=+309.425667669" watchObservedRunningTime="2026-06-09 12:00:24.574467942 +0000 UTC m=+309.446730933" Jun 09 12:00:27.543287 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.543252 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d88b9bdb9-gwnrn"] Jun 09 12:00:27.551942 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.551914 2562 generic.go:356] "Generic (PLEG): container finished" podID="3210dd5c-7a75-4748-8e92-e03a30b00980" containerID="218d9303f363258a57078b84e38e8b547edb25ce66298977f0c9d99b55bdb214" exitCode=0 Jun 09 12:00:27.569356 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.569329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-j4x8s" event={"ID":"3210dd5c-7a75-4748-8e92-e03a30b00980","Type":"ContainerDied","Data":"218d9303f363258a57078b84e38e8b547edb25ce66298977f0c9d99b55bdb214"} Jun 09 12:00:27.569505 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.569449 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.569834 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.569800 2562 scope.go:117] "RemoveContainer" containerID="218d9303f363258a57078b84e38e8b547edb25ce66298977f0c9d99b55bdb214" Jun 09 12:00:27.572765 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.572716 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6798dfdf99-fkk5j" podStartSLOduration=6.061095969 podStartE2EDuration="9.572685069s" totalImagesPullingTime="3.5115891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:00:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:27.570205313 +0000 UTC m=+312.442468325" watchObservedRunningTime="2026-06-09 12:00:27.572685069 +0000 UTC m=+312.444948057" Jun 09 12:00:27.577584 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.577562 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 12:00:27.580704 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.580255 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d88b9bdb9-gwnrn"] Jun 09 12:00:27.580704 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.580302 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6798dfdf99-fkk5j" event={"ID":"79ebb24c-5389-4392-b591-c6a10d694ed9","Type":"ContainerStarted","Data":"81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb"} Jun 09 12:00:27.631471 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.631445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnwvz\" (UniqueName: \"kubernetes.io/projected/22d95eb5-d32c-4272-8130-21961b979691-kube-api-access-wnwvz\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.631588 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.631490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-trusted-ca-bundle\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.632845 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.631657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-service-ca\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.632845 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.631740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-console-config\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.632845 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.631782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-oauth-serving-cert\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.632845 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.631898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-serving-cert\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.632845 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.632012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-oauth-config\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.733183 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.733141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-console-config\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.733347 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.733198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-oauth-serving-cert\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.733347 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.733245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-serving-cert\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.733347 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.733278 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-oauth-config\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.733347 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.733315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnwvz\" (UniqueName: \"kubernetes.io/projected/22d95eb5-d32c-4272-8130-21961b979691-kube-api-access-wnwvz\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.733347 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.733341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-trusted-ca-bundle\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.733596 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.733400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-service-ca\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.734024 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.733992 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-console-config\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.734387 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.734349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-oauth-serving-cert\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.734538 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.734414 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-service-ca\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.735326 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.735303 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-trusted-ca-bundle\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.736376 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.736348 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-oauth-config\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.737095 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.737055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-serving-cert\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.742519 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.742475 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnwvz\" (UniqueName: \"kubernetes.io/projected/22d95eb5-d32c-4272-8130-21961b979691-kube-api-access-wnwvz\") pod \"console-6d88b9bdb9-gwnrn\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:27.884900 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:27.884809 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:28.071918 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:28.071583 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d88b9bdb9-gwnrn"] Jun 09 12:00:28.075024 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:00:28.074986 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d95eb5_d32c_4272_8130_21961b979691.slice/crio-5618c9c9a9527a254cc57b5b0cba2ce44b88bd4e312b4321c96dca9f0abecaa2 WatchSource:0}: Error finding container 5618c9c9a9527a254cc57b5b0cba2ce44b88bd4e312b4321c96dca9f0abecaa2: Status 404 returned error can't find the container with id 5618c9c9a9527a254cc57b5b0cba2ce44b88bd4e312b4321c96dca9f0abecaa2 Jun 09 12:00:28.447057 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:28.447013 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:28.447230 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:28.447068 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:28.452924 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:28.452898 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:28.561438 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:28.561403 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-j4x8s" event={"ID":"3210dd5c-7a75-4748-8e92-e03a30b00980","Type":"ContainerStarted","Data":"e3aa40578101843530fc2bc87fbce066f8f60a47fe42e0453480f0283d9dd068"} Jun 09 12:00:28.563499 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:28.563431 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88b9bdb9-gwnrn" event={"ID":"22d95eb5-d32c-4272-8130-21961b979691","Type":"ContainerStarted","Data":"c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7"} Jun 09 12:00:28.563499 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:28.563479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88b9bdb9-gwnrn" event={"ID":"22d95eb5-d32c-4272-8130-21961b979691","Type":"ContainerStarted","Data":"5618c9c9a9527a254cc57b5b0cba2ce44b88bd4e312b4321c96dca9f0abecaa2"} Jun 09 12:00:28.568048 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:28.568021 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:00:28.612850 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:28.611675 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d88b9bdb9-gwnrn" podStartSLOduration=1.611653827 podStartE2EDuration="1.611653827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:28.610887223 +0000 UTC m=+313.483150213" watchObservedRunningTime="2026-06-09 12:00:28.611653827 +0000 UTC m=+313.483916817" Jun 09 12:00:30.219422 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:30.219389 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 12:00:30.223936 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:30.223910 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-844fd5f967-tx792" Jun 09 12:00:37.885212 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:37.885177 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:37.885674 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:37.885242 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:37.890192 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:37.890166 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:38.607874 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:38.607848 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:00:38.653699 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:00:38.653664 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6798dfdf99-fkk5j"] Jun 09 12:01:03.675317 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:03.675230 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6798dfdf99-fkk5j" podUID="79ebb24c-5389-4392-b591-c6a10d694ed9" containerName="console" containerID="cri-o://81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb" gracePeriod=15 Jun 09 12:01:03.946260 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:03.946183 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:01:04.050804 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.050771 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-serving-cert\") pod \"79ebb24c-5389-4392-b591-c6a10d694ed9\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " Jun 09 12:01:04.051001 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.050863 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-oauth-serving-cert\") pod \"79ebb24c-5389-4392-b591-c6a10d694ed9\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " Jun 09 12:01:04.051001 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.050886 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-oauth-config\") pod \"79ebb24c-5389-4392-b591-c6a10d694ed9\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " Jun 09 12:01:04.051001 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.050931 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-console-config\") pod \"79ebb24c-5389-4392-b591-c6a10d694ed9\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " Jun 09 12:01:04.051001 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.050954 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-service-ca\") pod \"79ebb24c-5389-4392-b591-c6a10d694ed9\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " Jun 09 12:01:04.051001 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.051000 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89sjt\" (UniqueName: \"kubernetes.io/projected/79ebb24c-5389-4392-b591-c6a10d694ed9-kube-api-access-89sjt\") pod \"79ebb24c-5389-4392-b591-c6a10d694ed9\" (UID: \"79ebb24c-5389-4392-b591-c6a10d694ed9\") " Jun 09 12:01:04.051368 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.051335 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79ebb24c-5389-4392-b591-c6a10d694ed9" (UID: "79ebb24c-5389-4392-b591-c6a10d694ed9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:04.051504 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.051343 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-console-config" (OuterVolumeSpecName: "console-config") pod "79ebb24c-5389-4392-b591-c6a10d694ed9" (UID: "79ebb24c-5389-4392-b591-c6a10d694ed9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:04.051582 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.051558 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-service-ca" (OuterVolumeSpecName: "service-ca") pod "79ebb24c-5389-4392-b591-c6a10d694ed9" (UID: "79ebb24c-5389-4392-b591-c6a10d694ed9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:04.053110 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.053086 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79ebb24c-5389-4392-b591-c6a10d694ed9" (UID: "79ebb24c-5389-4392-b591-c6a10d694ed9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:04.053189 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.053107 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79ebb24c-5389-4392-b591-c6a10d694ed9" (UID: "79ebb24c-5389-4392-b591-c6a10d694ed9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:04.053252 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.053224 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ebb24c-5389-4392-b591-c6a10d694ed9-kube-api-access-89sjt" (OuterVolumeSpecName: "kube-api-access-89sjt") pod "79ebb24c-5389-4392-b591-c6a10d694ed9" (UID: "79ebb24c-5389-4392-b591-c6a10d694ed9"). InnerVolumeSpecName "kube-api-access-89sjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:01:04.151802 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.151763 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-oauth-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:04.151802 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.151795 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-oauth-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:04.151802 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.151806 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-console-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:04.152025 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.151840 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79ebb24c-5389-4392-b591-c6a10d694ed9-service-ca\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:04.152025 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.151853 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89sjt\" (UniqueName: \"kubernetes.io/projected/79ebb24c-5389-4392-b591-c6a10d694ed9-kube-api-access-89sjt\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:04.152025 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.151866 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79ebb24c-5389-4392-b591-c6a10d694ed9-console-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:04.707557 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.707516 2562 generic.go:356] "Generic (PLEG): container finished" podID="79ebb24c-5389-4392-b591-c6a10d694ed9" containerID="81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb" exitCode=0 Jun 09 12:01:04.708049 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.707566 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6798dfdf99-fkk5j" Jun 09 12:01:04.708049 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.707608 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6798dfdf99-fkk5j" event={"ID":"79ebb24c-5389-4392-b591-c6a10d694ed9","Type":"ContainerDied","Data":"81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb"} Jun 09 12:01:04.708049 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.707659 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6798dfdf99-fkk5j" event={"ID":"79ebb24c-5389-4392-b591-c6a10d694ed9","Type":"ContainerDied","Data":"c65cf6a49c633f6ba2942a652d900eb3145f25ba4e96d5da4f7867671c8b9c15"} Jun 09 12:01:04.708049 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.707678 2562 scope.go:117] "RemoveContainer" containerID="81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb" Jun 09 12:01:04.716025 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.716002 2562 scope.go:117] "RemoveContainer" containerID="81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb" Jun 09 12:01:04.716807 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:01:04.716719 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb\": container with ID starting with 81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb not found: ID does not exist" containerID="81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb" Jun 09 12:01:04.716807 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.716758 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb"} err="failed to get container status \"81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb\": rpc error: code = NotFound desc = could not find container \"81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb\": container with ID starting with 81334a402b2c358d7f3f60cd40c11f5d08f59892c933d02308f9b4e42bf50dfb not found: ID does not exist" Jun 09 12:01:04.727881 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.727860 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6798dfdf99-fkk5j"] Jun 09 12:01:04.731481 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:04.731461 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6798dfdf99-fkk5j"] Jun 09 12:01:05.568270 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:05.568236 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79ebb24c-5389-4392-b591-c6a10d694ed9" path="/var/lib/kubelet/pods/79ebb24c-5389-4392-b591-c6a10d694ed9/volumes" Jun 09 12:01:09.951960 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.951928 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6dcd889c4-c2hbm"] Jun 09 12:01:09.952425 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.952273 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79ebb24c-5389-4392-b591-c6a10d694ed9" containerName="console" Jun 09 12:01:09.952425 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.952287 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="79ebb24c-5389-4392-b591-c6a10d694ed9" containerName="console" Jun 09 12:01:09.952425 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.952347 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="79ebb24c-5389-4392-b591-c6a10d694ed9" containerName="console" Jun 09 12:01:09.955655 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.955638 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:09.957931 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.957907 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 12:01:09.958029 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.957907 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 12:01:09.958336 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.958318 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 12:01:09.958413 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.958360 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xbqsv\"" Jun 09 12:01:09.958413 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.958369 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 12:01:09.958413 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.958389 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 12:01:09.964911 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.964885 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 12:01:09.976978 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:09.976954 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dcd889c4-c2hbm"] Jun 09 12:01:10.104033 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.103989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-serving-certs-ca-bundle\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.104199 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.104039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.104199 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.104072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.104199 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.104106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-telemeter-client-tls\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.104199 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.104136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-metrics-client-ca\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.104199 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.104168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-secret-telemeter-client\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.104199 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.104189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45t86\" (UniqueName: \"kubernetes.io/projected/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-kube-api-access-45t86\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.104389 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.104239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-federate-client-tls\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.205091 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-serving-certs-ca-bundle\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.205091 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.205224 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.205224 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-telemeter-client-tls\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.205224 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-metrics-client-ca\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.205224 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-secret-telemeter-client\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.205407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45t86\" (UniqueName: \"kubernetes.io/projected/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-kube-api-access-45t86\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.205407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-federate-client-tls\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.205945 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205895 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-serving-certs-ca-bundle\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.206065 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.205947 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-metrics-client-ca\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.206065 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.206047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.207749 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.207721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.207859 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.207725 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-telemeter-client-tls\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.208088 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.208071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-federate-client-tls\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.208146 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.208101 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-secret-telemeter-client\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.213945 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.213927 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45t86\" (UniqueName: \"kubernetes.io/projected/7856819d-5ed9-424d-ad66-a34e4d3ebe2e-kube-api-access-45t86\") pod \"telemeter-client-6dcd889c4-c2hbm\" (UID: \"7856819d-5ed9-424d-ad66-a34e4d3ebe2e\") " pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.265828 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.265787 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" Jun 09 12:01:10.399129 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.399020 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dcd889c4-c2hbm"] Jun 09 12:01:10.401352 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:01:10.401327 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7856819d_5ed9_424d_ad66_a34e4d3ebe2e.slice/crio-0612236d3d7d119ad1d927432051bb4069fd383a7817327921b21f43889be028 WatchSource:0}: Error finding container 0612236d3d7d119ad1d927432051bb4069fd383a7817327921b21f43889be028: Status 404 returned error can't find the container with id 0612236d3d7d119ad1d927432051bb4069fd383a7817327921b21f43889be028 Jun 09 12:01:10.732892 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:10.732854 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" event={"ID":"7856819d-5ed9-424d-ad66-a34e4d3ebe2e","Type":"ContainerStarted","Data":"0612236d3d7d119ad1d927432051bb4069fd383a7817327921b21f43889be028"} Jun 09 12:01:12.742697 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:12.742663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" event={"ID":"7856819d-5ed9-424d-ad66-a34e4d3ebe2e","Type":"ContainerStarted","Data":"8a1affd6e34623f031eb29cb52b53f0caeeefe4c4640630d5653ddbc0d370d47"} Jun 09 12:01:13.748617 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:13.748580 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" event={"ID":"7856819d-5ed9-424d-ad66-a34e4d3ebe2e","Type":"ContainerStarted","Data":"e1a24e85208d596383a68d6074181dc61607336661420a33b0fb1f1603000539"} Jun 09 12:01:13.749018 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:13.748638 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" event={"ID":"7856819d-5ed9-424d-ad66-a34e4d3ebe2e","Type":"ContainerStarted","Data":"5a93ef1b6d51c9583c44396359d1da21784f995e484cd6f100697a35aebe2a32"} Jun 09 12:01:13.773372 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:13.773329 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6dcd889c4-c2hbm" podStartSLOduration=1.996560808 podStartE2EDuration="4.773314842s" totalImagesPullingTime="2.776754034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:01:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:01:13.772780871 +0000 UTC m=+358.645043860" watchObservedRunningTime="2026-06-09 12:01:13.773314842 +0000 UTC m=+358.645577824" Jun 09 12:01:14.373228 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.373195 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-88b559798-xqq5g"] Jun 09 12:01:14.375706 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.375683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.389244 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.389223 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88b559798-xqq5g"] Jun 09 12:01:14.443212 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.443176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-serving-cert\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.443212 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.443221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-869ww\" (UniqueName: \"kubernetes.io/projected/1f306ed0-d2cf-479a-b11c-1fc57e90b455-kube-api-access-869ww\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.443482 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.443244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-service-ca\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.443482 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.443266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-oauth-serving-cert\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.443482 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.443358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-config\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.443482 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.443414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-oauth-config\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.443482 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.443466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-trusted-ca-bundle\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.544682 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.544659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-869ww\" (UniqueName: \"kubernetes.io/projected/1f306ed0-d2cf-479a-b11c-1fc57e90b455-kube-api-access-869ww\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.544800 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.544688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-service-ca\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.544800 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.544704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-oauth-serving-cert\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.544800 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.544737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-config\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.544979 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.544868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-oauth-config\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.544979 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.544907 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-trusted-ca-bundle\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.544979 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.544952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-serving-cert\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.545453 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.545431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-config\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.545528 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.545454 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-service-ca\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.545528 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.545454 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-oauth-serving-cert\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.545889 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.545869 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-trusted-ca-bundle\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.547700 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.547681 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-serving-cert\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.547783 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.547743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-oauth-config\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.553008 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.552984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-869ww\" (UniqueName: \"kubernetes.io/projected/1f306ed0-d2cf-479a-b11c-1fc57e90b455-kube-api-access-869ww\") pod \"console-88b559798-xqq5g\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.685317 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.685292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:14.814445 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:14.814420 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88b559798-xqq5g"] Jun 09 12:01:14.816958 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:01:14.816929 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f306ed0_d2cf_479a_b11c_1fc57e90b455.slice/crio-087e52259c436a7b66241f68d3187903d39107cb62d0704ef040f0c4c550feee WatchSource:0}: Error finding container 087e52259c436a7b66241f68d3187903d39107cb62d0704ef040f0c4c550feee: Status 404 returned error can't find the container with id 087e52259c436a7b66241f68d3187903d39107cb62d0704ef040f0c4c550feee Jun 09 12:01:15.758268 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:15.758235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88b559798-xqq5g" event={"ID":"1f306ed0-d2cf-479a-b11c-1fc57e90b455","Type":"ContainerStarted","Data":"75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32"} Jun 09 12:01:15.758414 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:15.758282 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88b559798-xqq5g" event={"ID":"1f306ed0-d2cf-479a-b11c-1fc57e90b455","Type":"ContainerStarted","Data":"087e52259c436a7b66241f68d3187903d39107cb62d0704ef040f0c4c550feee"} Jun 09 12:01:15.777665 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:15.777612 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-88b559798-xqq5g" podStartSLOduration=1.7775985539999999 podStartE2EDuration="1.777598554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:01:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:01:15.776393369 +0000 UTC m=+360.648656385" watchObservedRunningTime="2026-06-09 12:01:15.777598554 +0000 UTC m=+360.649861542" Jun 09 12:01:24.685971 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:24.685940 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:24.686318 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:24.685995 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:24.690334 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:24.690313 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:24.803306 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:24.803282 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:01:24.848834 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:24.848794 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d88b9bdb9-gwnrn"] Jun 09 12:01:49.873617 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:49.873556 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d88b9bdb9-gwnrn" podUID="22d95eb5-d32c-4272-8130-21961b979691" containerName="console" containerID="cri-o://c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7" gracePeriod=15 Jun 09 12:01:50.131581 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.131519 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:01:50.220764 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.220736 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-service-ca\") pod \"22d95eb5-d32c-4272-8130-21961b979691\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " Jun 09 12:01:50.220958 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.220774 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnwvz\" (UniqueName: \"kubernetes.io/projected/22d95eb5-d32c-4272-8130-21961b979691-kube-api-access-wnwvz\") pod \"22d95eb5-d32c-4272-8130-21961b979691\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " Jun 09 12:01:50.221057 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221033 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-oauth-serving-cert\") pod \"22d95eb5-d32c-4272-8130-21961b979691\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " Jun 09 12:01:50.221119 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221103 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-console-config\") pod \"22d95eb5-d32c-4272-8130-21961b979691\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " Jun 09 12:01:50.221119 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221106 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-service-ca" (OuterVolumeSpecName: "service-ca") pod "22d95eb5-d32c-4272-8130-21961b979691" (UID: "22d95eb5-d32c-4272-8130-21961b979691"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:50.221208 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221156 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-trusted-ca-bundle\") pod \"22d95eb5-d32c-4272-8130-21961b979691\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " Jun 09 12:01:50.221208 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221179 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-serving-cert\") pod \"22d95eb5-d32c-4272-8130-21961b979691\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " Jun 09 12:01:50.221301 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221224 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-oauth-config\") pod \"22d95eb5-d32c-4272-8130-21961b979691\" (UID: \"22d95eb5-d32c-4272-8130-21961b979691\") " Jun 09 12:01:50.221440 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221393 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "22d95eb5-d32c-4272-8130-21961b979691" (UID: "22d95eb5-d32c-4272-8130-21961b979691"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:50.221440 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221419 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-console-config" (OuterVolumeSpecName: "console-config") pod "22d95eb5-d32c-4272-8130-21961b979691" (UID: "22d95eb5-d32c-4272-8130-21961b979691"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:50.221626 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221460 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-service-ca\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:50.221626 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221479 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-oauth-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:50.221725 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.221673 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "22d95eb5-d32c-4272-8130-21961b979691" (UID: "22d95eb5-d32c-4272-8130-21961b979691"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:50.223512 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.223485 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22d95eb5-d32c-4272-8130-21961b979691-kube-api-access-wnwvz" (OuterVolumeSpecName: "kube-api-access-wnwvz") pod "22d95eb5-d32c-4272-8130-21961b979691" (UID: "22d95eb5-d32c-4272-8130-21961b979691"). InnerVolumeSpecName "kube-api-access-wnwvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:01:50.223604 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.223517 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "22d95eb5-d32c-4272-8130-21961b979691" (UID: "22d95eb5-d32c-4272-8130-21961b979691"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:50.223604 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.223534 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "22d95eb5-d32c-4272-8130-21961b979691" (UID: "22d95eb5-d32c-4272-8130-21961b979691"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:50.322080 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.322047 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnwvz\" (UniqueName: \"kubernetes.io/projected/22d95eb5-d32c-4272-8130-21961b979691-kube-api-access-wnwvz\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:50.322080 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.322080 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-console-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:50.322270 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.322095 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22d95eb5-d32c-4272-8130-21961b979691-trusted-ca-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:50.322270 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.322108 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:50.322270 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.322122 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22d95eb5-d32c-4272-8130-21961b979691-console-oauth-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:01:50.907740 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.907706 2562 generic.go:356] "Generic (PLEG): container finished" podID="22d95eb5-d32c-4272-8130-21961b979691" containerID="c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7" exitCode=0 Jun 09 12:01:50.907740 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.907744 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88b9bdb9-gwnrn" event={"ID":"22d95eb5-d32c-4272-8130-21961b979691","Type":"ContainerDied","Data":"c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7"} Jun 09 12:01:50.908229 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.907752 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88b9bdb9-gwnrn" Jun 09 12:01:50.908229 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.907779 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88b9bdb9-gwnrn" event={"ID":"22d95eb5-d32c-4272-8130-21961b979691","Type":"ContainerDied","Data":"5618c9c9a9527a254cc57b5b0cba2ce44b88bd4e312b4321c96dca9f0abecaa2"} Jun 09 12:01:50.908229 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.907799 2562 scope.go:117] "RemoveContainer" containerID="c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7" Jun 09 12:01:50.916402 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.916387 2562 scope.go:117] "RemoveContainer" containerID="c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7" Jun 09 12:01:50.916669 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:01:50.916650 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7\": container with ID starting with c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7 not found: ID does not exist" containerID="c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7" Jun 09 12:01:50.916738 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.916683 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7"} err="failed to get container status \"c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7\": rpc error: code = NotFound desc = could not find container \"c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7\": container with ID starting with c84bc620174e994532ddfa4feb7a8b158742d1ff5e90048c610956c038552ca7 not found: ID does not exist" Jun 09 12:01:50.928311 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.928290 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d88b9bdb9-gwnrn"] Jun 09 12:01:50.931780 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:50.931760 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d88b9bdb9-gwnrn"] Jun 09 12:01:51.567865 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:01:51.567810 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22d95eb5-d32c-4272-8130-21961b979691" path="/var/lib/kubelet/pods/22d95eb5-d32c-4272-8130-21961b979691/volumes" Jun 09 12:02:35.492350 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.492260 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc6f678b7-bd5w4"] Jun 09 12:02:35.492951 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.492625 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22d95eb5-d32c-4272-8130-21961b979691" containerName="console" Jun 09 12:02:35.492951 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.492641 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="22d95eb5-d32c-4272-8130-21961b979691" containerName="console" Jun 09 12:02:35.496763 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.496734 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="22d95eb5-d32c-4272-8130-21961b979691" containerName="console" Jun 09 12:02:35.499767 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.499739 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.509433 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.509406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-oauth-serving-cert\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.509577 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.509448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-oauth-config\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.509577 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.509492 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbgg4\" (UniqueName: \"kubernetes.io/projected/2272e824-1039-4ace-aeca-a945204e8780-kube-api-access-zbgg4\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.509577 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.509565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-console-config\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.509747 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.509636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-serving-cert\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.509747 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.509690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-trusted-ca-bundle\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.509747 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.509729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-service-ca\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.539591 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.539559 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc6f678b7-bd5w4"] Jun 09 12:02:35.610214 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.610177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgg4\" (UniqueName: \"kubernetes.io/projected/2272e824-1039-4ace-aeca-a945204e8780-kube-api-access-zbgg4\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.610398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.610221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-console-config\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.610398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.610249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-serving-cert\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.610398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.610279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-trusted-ca-bundle\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.610398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.610307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-service-ca\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.610398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.610325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-oauth-serving-cert\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.610398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.610358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-oauth-config\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.611141 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.611115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-oauth-serving-cert\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.611303 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.611281 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-service-ca\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.611303 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.611294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-console-config\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.611406 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.611383 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-trusted-ca-bundle\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.613012 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.612989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-serving-cert\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.613109 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.613096 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-oauth-config\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.619155 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.619134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbgg4\" (UniqueName: \"kubernetes.io/projected/2272e824-1039-4ace-aeca-a945204e8780-kube-api-access-zbgg4\") pod \"console-7dc6f678b7-bd5w4\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.810332 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.810241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:35.949158 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:35.949126 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc6f678b7-bd5w4"] Jun 09 12:02:35.951562 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:02:35.951535 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2272e824_1039_4ace_aeca_a945204e8780.slice/crio-a23192688e21e96f386a032213b1ac476e0335b0ac03aacd90619586dd61a68d WatchSource:0}: Error finding container a23192688e21e96f386a032213b1ac476e0335b0ac03aacd90619586dd61a68d: Status 404 returned error can't find the container with id a23192688e21e96f386a032213b1ac476e0335b0ac03aacd90619586dd61a68d Jun 09 12:02:36.097025 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:36.096932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc6f678b7-bd5w4" event={"ID":"2272e824-1039-4ace-aeca-a945204e8780","Type":"ContainerStarted","Data":"b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285"} Jun 09 12:02:36.097025 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:36.097019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc6f678b7-bd5w4" event={"ID":"2272e824-1039-4ace-aeca-a945204e8780","Type":"ContainerStarted","Data":"a23192688e21e96f386a032213b1ac476e0335b0ac03aacd90619586dd61a68d"} Jun 09 12:02:36.134420 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:36.134364 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc6f678b7-bd5w4" podStartSLOduration=1.134349776 podStartE2EDuration="1.134349776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:02:36.134264738 +0000 UTC m=+441.006527738" watchObservedRunningTime="2026-06-09 12:02:36.134349776 +0000 UTC m=+441.006612763" Jun 09 12:02:45.810405 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:45.810367 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:45.810914 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:45.810432 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:45.815375 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:45.815350 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:46.143582 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:46.143501 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:02:46.199971 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:02:46.199938 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88b559798-xqq5g"] Jun 09 12:03:11.223060 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.223018 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-88b559798-xqq5g" podUID="1f306ed0-d2cf-479a-b11c-1fc57e90b455" containerName="console" containerID="cri-o://75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32" gracePeriod=15 Jun 09 12:03:11.472697 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.472663 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:03:11.634069 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.633971 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-serving-cert\") pod \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " Jun 09 12:03:11.634069 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634034 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-trusted-ca-bundle\") pod \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " Jun 09 12:03:11.634293 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634078 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-service-ca\") pod \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " Jun 09 12:03:11.634293 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634146 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-config\") pod \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " Jun 09 12:03:11.634293 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634169 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-oauth-config\") pod \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " Jun 09 12:03:11.634293 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634207 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-oauth-serving-cert\") pod \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " Jun 09 12:03:11.634293 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634233 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-869ww\" (UniqueName: \"kubernetes.io/projected/1f306ed0-d2cf-479a-b11c-1fc57e90b455-kube-api-access-869ww\") pod \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\" (UID: \"1f306ed0-d2cf-479a-b11c-1fc57e90b455\") " Jun 09 12:03:11.634517 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634468 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f306ed0-d2cf-479a-b11c-1fc57e90b455" (UID: "1f306ed0-d2cf-479a-b11c-1fc57e90b455"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:03:11.634573 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634533 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f306ed0-d2cf-479a-b11c-1fc57e90b455" (UID: "1f306ed0-d2cf-479a-b11c-1fc57e90b455"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:03:11.634667 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634644 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-config" (OuterVolumeSpecName: "console-config") pod "1f306ed0-d2cf-479a-b11c-1fc57e90b455" (UID: "1f306ed0-d2cf-479a-b11c-1fc57e90b455"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:03:11.634731 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.634663 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f306ed0-d2cf-479a-b11c-1fc57e90b455" (UID: "1f306ed0-d2cf-479a-b11c-1fc57e90b455"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:03:11.636445 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.636414 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f306ed0-d2cf-479a-b11c-1fc57e90b455" (UID: "1f306ed0-d2cf-479a-b11c-1fc57e90b455"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:03:11.636445 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.636431 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f306ed0-d2cf-479a-b11c-1fc57e90b455" (UID: "1f306ed0-d2cf-479a-b11c-1fc57e90b455"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:03:11.636606 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.636528 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f306ed0-d2cf-479a-b11c-1fc57e90b455-kube-api-access-869ww" (OuterVolumeSpecName: "kube-api-access-869ww") pod "1f306ed0-d2cf-479a-b11c-1fc57e90b455" (UID: "1f306ed0-d2cf-479a-b11c-1fc57e90b455"). InnerVolumeSpecName "kube-api-access-869ww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:03:11.735108 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.735065 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:11.735108 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.735099 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-oauth-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:11.735108 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.735110 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-oauth-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:11.735108 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.735120 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-869ww\" (UniqueName: \"kubernetes.io/projected/1f306ed0-d2cf-479a-b11c-1fc57e90b455-kube-api-access-869ww\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:11.735391 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.735129 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f306ed0-d2cf-479a-b11c-1fc57e90b455-console-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:11.735391 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.735137 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-trusted-ca-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:11.735391 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:11.735145 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f306ed0-d2cf-479a-b11c-1fc57e90b455-service-ca\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:12.256801 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:12.256766 2562 generic.go:356] "Generic (PLEG): container finished" podID="1f306ed0-d2cf-479a-b11c-1fc57e90b455" containerID="75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32" exitCode=0 Jun 09 12:03:12.257214 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:12.256832 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88b559798-xqq5g" Jun 09 12:03:12.257214 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:12.256854 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88b559798-xqq5g" event={"ID":"1f306ed0-d2cf-479a-b11c-1fc57e90b455","Type":"ContainerDied","Data":"75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32"} Jun 09 12:03:12.257214 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:12.256908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88b559798-xqq5g" event={"ID":"1f306ed0-d2cf-479a-b11c-1fc57e90b455","Type":"ContainerDied","Data":"087e52259c436a7b66241f68d3187903d39107cb62d0704ef040f0c4c550feee"} Jun 09 12:03:12.257214 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:12.256931 2562 scope.go:117] "RemoveContainer" containerID="75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32" Jun 09 12:03:12.268225 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:12.268204 2562 scope.go:117] "RemoveContainer" containerID="75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32" Jun 09 12:03:12.268531 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:03:12.268510 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32\": container with ID starting with 75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32 not found: ID does not exist" containerID="75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32" Jun 09 12:03:12.268575 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:12.268541 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32"} err="failed to get container status \"75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32\": rpc error: code = NotFound desc = could not find container \"75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32\": container with ID starting with 75807df3e509643eb7d23e3bf6ffb359e23e8bc7df0d64c0c7f97ae618a6cb32 not found: ID does not exist" Jun 09 12:03:12.279922 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:12.279890 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88b559798-xqq5g"] Jun 09 12:03:12.284018 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:12.283990 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-88b559798-xqq5g"] Jun 09 12:03:13.567664 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:13.567630 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f306ed0-d2cf-479a-b11c-1fc57e90b455" path="/var/lib/kubelet/pods/1f306ed0-d2cf-479a-b11c-1fc57e90b455/volumes" Jun 09 12:03:31.734121 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.734088 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv"] Jun 09 12:03:31.734514 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.734406 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f306ed0-d2cf-479a-b11c-1fc57e90b455" containerName="console" Jun 09 12:03:31.734514 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.734418 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f306ed0-d2cf-479a-b11c-1fc57e90b455" containerName="console" Jun 09 12:03:31.734514 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.734484 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f306ed0-d2cf-479a-b11c-1fc57e90b455" containerName="console" Jun 09 12:03:31.737517 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.737500 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:31.740360 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.740339 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:03:31.741194 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.741177 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:03:31.741288 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.741218 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gbmwp\"" Jun 09 12:03:31.748584 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.748565 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv"] Jun 09 12:03:31.792316 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.792283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:31.792457 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.792322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:31.792457 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.792343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phwn7\" (UniqueName: \"kubernetes.io/projected/0ad59571-93d8-4374-9824-df474f4b6658-kube-api-access-phwn7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:31.893553 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.893521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:31.893699 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.893559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:31.893699 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.893583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phwn7\" (UniqueName: \"kubernetes.io/projected/0ad59571-93d8-4374-9824-df474f4b6658-kube-api-access-phwn7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:31.893956 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.893932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:31.894032 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.893968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:31.902891 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:31.902872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phwn7\" (UniqueName: \"kubernetes.io/projected/0ad59571-93d8-4374-9824-df474f4b6658-kube-api-access-phwn7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:32.047094 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:32.047011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:32.173654 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:32.173591 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv"] Jun 09 12:03:32.176307 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:03:32.176272 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad59571_93d8_4374_9824_df474f4b6658.slice/crio-ab12d846a880dd5b8edca084d251a3fce86f57816900d083e1c67944dbff1b03 WatchSource:0}: Error finding container ab12d846a880dd5b8edca084d251a3fce86f57816900d083e1c67944dbff1b03: Status 404 returned error can't find the container with id ab12d846a880dd5b8edca084d251a3fce86f57816900d083e1c67944dbff1b03 Jun 09 12:03:32.334692 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:32.334610 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" event={"ID":"0ad59571-93d8-4374-9824-df474f4b6658","Type":"ContainerStarted","Data":"ab12d846a880dd5b8edca084d251a3fce86f57816900d083e1c67944dbff1b03"} Jun 09 12:03:37.357203 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:37.357159 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ad59571-93d8-4374-9824-df474f4b6658" containerID="5e08d6409ba3f46e5cef0800bdd6259e8b85ad99cea4cf967b007d2e8fac16c5" exitCode=0 Jun 09 12:03:37.357586 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:37.357212 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" event={"ID":"0ad59571-93d8-4374-9824-df474f4b6658","Type":"ContainerDied","Data":"5e08d6409ba3f46e5cef0800bdd6259e8b85ad99cea4cf967b007d2e8fac16c5"} Jun 09 12:03:40.371046 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:40.371010 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ad59571-93d8-4374-9824-df474f4b6658" containerID="67b8c6874c4d8eb0b7880c0a195e0e1ca08eb01e9c677c2188ec41f93592ece8" exitCode=0 Jun 09 12:03:40.371434 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:40.371095 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" event={"ID":"0ad59571-93d8-4374-9824-df474f4b6658","Type":"ContainerDied","Data":"67b8c6874c4d8eb0b7880c0a195e0e1ca08eb01e9c677c2188ec41f93592ece8"} Jun 09 12:03:50.419072 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:50.419037 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ad59571-93d8-4374-9824-df474f4b6658" containerID="fb505936e228119cb72321dad384a3bf5b5c2697d96c38b98f8dcf1b56a5d49e" exitCode=0 Jun 09 12:03:50.419518 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:50.419127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" event={"ID":"0ad59571-93d8-4374-9824-df474f4b6658","Type":"ContainerDied","Data":"fb505936e228119cb72321dad384a3bf5b5c2697d96c38b98f8dcf1b56a5d49e"} Jun 09 12:03:51.563525 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.563496 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:51.670589 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.670548 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-util\") pod \"0ad59571-93d8-4374-9824-df474f4b6658\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " Jun 09 12:03:51.670783 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.670646 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-bundle\") pod \"0ad59571-93d8-4374-9824-df474f4b6658\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " Jun 09 12:03:51.670783 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.670672 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phwn7\" (UniqueName: \"kubernetes.io/projected/0ad59571-93d8-4374-9824-df474f4b6658-kube-api-access-phwn7\") pod \"0ad59571-93d8-4374-9824-df474f4b6658\" (UID: \"0ad59571-93d8-4374-9824-df474f4b6658\") " Jun 09 12:03:51.671439 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.671407 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-bundle" (OuterVolumeSpecName: "bundle") pod "0ad59571-93d8-4374-9824-df474f4b6658" (UID: "0ad59571-93d8-4374-9824-df474f4b6658"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:03:51.672968 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.672938 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ad59571-93d8-4374-9824-df474f4b6658-kube-api-access-phwn7" (OuterVolumeSpecName: "kube-api-access-phwn7") pod "0ad59571-93d8-4374-9824-df474f4b6658" (UID: "0ad59571-93d8-4374-9824-df474f4b6658"). InnerVolumeSpecName "kube-api-access-phwn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:03:51.675003 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.674957 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-util" (OuterVolumeSpecName: "util") pod "0ad59571-93d8-4374-9824-df474f4b6658" (UID: "0ad59571-93d8-4374-9824-df474f4b6658"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:03:51.771731 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.771685 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:51.771731 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.771725 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad59571-93d8-4374-9824-df474f4b6658-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:51.771731 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:51.771734 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phwn7\" (UniqueName: \"kubernetes.io/projected/0ad59571-93d8-4374-9824-df474f4b6658-kube-api-access-phwn7\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:03:52.429952 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:52.429911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" event={"ID":"0ad59571-93d8-4374-9824-df474f4b6658","Type":"ContainerDied","Data":"ab12d846a880dd5b8edca084d251a3fce86f57816900d083e1c67944dbff1b03"} Jun 09 12:03:52.430161 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:52.429981 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab12d846a880dd5b8edca084d251a3fce86f57816900d083e1c67944dbff1b03" Jun 09 12:03:52.430161 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:52.429930 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9mkmv" Jun 09 12:03:59.946060 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.946026 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg"] Jun 09 12:03:59.946610 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.946342 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad59571-93d8-4374-9824-df474f4b6658" containerName="pull" Jun 09 12:03:59.946610 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.946352 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad59571-93d8-4374-9824-df474f4b6658" containerName="pull" Jun 09 12:03:59.946610 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.946362 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad59571-93d8-4374-9824-df474f4b6658" containerName="util" Jun 09 12:03:59.946610 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.946367 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad59571-93d8-4374-9824-df474f4b6658" containerName="util" Jun 09 12:03:59.946610 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.946383 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad59571-93d8-4374-9824-df474f4b6658" containerName="extract" Jun 09 12:03:59.946610 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.946389 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad59571-93d8-4374-9824-df474f4b6658" containerName="extract" Jun 09 12:03:59.946610 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.946444 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ad59571-93d8-4374-9824-df474f4b6658" containerName="extract" Jun 09 12:03:59.951177 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.951158 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" Jun 09 12:03:59.958179 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.958155 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:03:59.958305 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.958202 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 12:03:59.958544 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.958527 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4cvft\"" Jun 09 12:03:59.968905 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:03:59.968878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg"] Jun 09 12:04:00.047429 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:00.047390 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f64679d3-3a8e-4848-9e6d-87500b9758ab-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4ntrg\" (UID: \"f64679d3-3a8e-4848-9e6d-87500b9758ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" Jun 09 12:04:00.047623 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:00.047475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn9k4\" (UniqueName: \"kubernetes.io/projected/f64679d3-3a8e-4848-9e6d-87500b9758ab-kube-api-access-tn9k4\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4ntrg\" (UID: \"f64679d3-3a8e-4848-9e6d-87500b9758ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" Jun 09 12:04:00.148027 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:00.147990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f64679d3-3a8e-4848-9e6d-87500b9758ab-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4ntrg\" (UID: \"f64679d3-3a8e-4848-9e6d-87500b9758ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" Jun 09 12:04:00.148220 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:00.148061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn9k4\" (UniqueName: \"kubernetes.io/projected/f64679d3-3a8e-4848-9e6d-87500b9758ab-kube-api-access-tn9k4\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4ntrg\" (UID: \"f64679d3-3a8e-4848-9e6d-87500b9758ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" Jun 09 12:04:00.148401 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:00.148380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f64679d3-3a8e-4848-9e6d-87500b9758ab-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4ntrg\" (UID: \"f64679d3-3a8e-4848-9e6d-87500b9758ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" Jun 09 12:04:00.158098 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:00.158069 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn9k4\" (UniqueName: \"kubernetes.io/projected/f64679d3-3a8e-4848-9e6d-87500b9758ab-kube-api-access-tn9k4\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4ntrg\" (UID: \"f64679d3-3a8e-4848-9e6d-87500b9758ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" Jun 09 12:04:00.260453 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:00.260359 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" Jun 09 12:04:00.398283 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:00.398254 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg"] Jun 09 12:04:00.401178 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:04:00.401140 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64679d3_3a8e_4848_9e6d_87500b9758ab.slice/crio-d05c8d1123ddaba5769fbd746761be1460d37706020102143f92d0cdf4c8f80e WatchSource:0}: Error finding container d05c8d1123ddaba5769fbd746761be1460d37706020102143f92d0cdf4c8f80e: Status 404 returned error can't find the container with id d05c8d1123ddaba5769fbd746761be1460d37706020102143f92d0cdf4c8f80e Jun 09 12:04:00.464565 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:00.464528 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" event={"ID":"f64679d3-3a8e-4848-9e6d-87500b9758ab","Type":"ContainerStarted","Data":"d05c8d1123ddaba5769fbd746761be1460d37706020102143f92d0cdf4c8f80e"} Jun 09 12:04:02.482386 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:02.482347 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" event={"ID":"f64679d3-3a8e-4848-9e6d-87500b9758ab","Type":"ContainerStarted","Data":"0af0a77774bf42c7d15f82e5f3976c5b4c07d05e39b0515e598f76cbb9588cf1"} Jun 09 12:04:02.548882 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:02.548798 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4ntrg" podStartSLOduration=1.7971995939999998 podStartE2EDuration="3.548776582s" totalImagesPullingTime="1.751576988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:02.544847573 +0000 UTC m=+527.417110558" watchObservedRunningTime="2026-06-09 12:04:02.548776582 +0000 UTC m=+527.421039570" Jun 09 12:04:04.289688 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.289649 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl"] Jun 09 12:04:04.292411 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.292393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.301515 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.301497 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:04:04.301686 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.301670 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gbmwp\"" Jun 09 12:04:04.302373 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.302359 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:04:04.386112 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.386061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbm9m\" (UniqueName: \"kubernetes.io/projected/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-kube-api-access-mbm9m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.386317 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.386176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.386317 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.386200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.398664 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.398622 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl"] Jun 09 12:04:04.486853 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.486793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.486853 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.486853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.487063 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.486891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbm9m\" (UniqueName: \"kubernetes.io/projected/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-kube-api-access-mbm9m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.487229 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.487211 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.487287 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.487249 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.504531 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.504497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbm9m\" (UniqueName: \"kubernetes.io/projected/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-kube-api-access-mbm9m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.601890 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.601787 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:04.740935 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:04.740903 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl"] Jun 09 12:04:04.744690 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:04:04.744662 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e985cc3_1f6d_4ef8_b9f6_d5cb67e3bfc9.slice/crio-c317beb2ebab922b917fc2a0a61b6dd3e6c9f156c0931383a2286a2d5e4867f9 WatchSource:0}: Error finding container c317beb2ebab922b917fc2a0a61b6dd3e6c9f156c0931383a2286a2d5e4867f9: Status 404 returned error can't find the container with id c317beb2ebab922b917fc2a0a61b6dd3e6c9f156c0931383a2286a2d5e4867f9 Jun 09 12:04:05.497024 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:05.496991 2562 generic.go:356] "Generic (PLEG): container finished" podID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerID="0dcac82d78a6634e056f041c553fa438ca6402f98107022443ef135bb2a78b55" exitCode=0 Jun 09 12:04:05.497401 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:05.497053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" event={"ID":"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9","Type":"ContainerDied","Data":"0dcac82d78a6634e056f041c553fa438ca6402f98107022443ef135bb2a78b55"} Jun 09 12:04:05.497401 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:05.497094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" event={"ID":"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9","Type":"ContainerStarted","Data":"c317beb2ebab922b917fc2a0a61b6dd3e6c9f156c0931383a2286a2d5e4867f9"} Jun 09 12:04:07.508454 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:07.508422 2562 generic.go:356] "Generic (PLEG): container finished" podID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerID="c6ba66c2f7c7226acb113c0cd98d2cd3cad91dd7a6995760fdfb096062f58595" exitCode=0 Jun 09 12:04:07.508863 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:07.508513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" event={"ID":"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9","Type":"ContainerDied","Data":"c6ba66c2f7c7226acb113c0cd98d2cd3cad91dd7a6995760fdfb096062f58595"} Jun 09 12:04:08.425626 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.425583 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd"] Jun 09 12:04:08.427791 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.427775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" Jun 09 12:04:08.430107 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.430079 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 12:04:08.430912 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.430882 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rt5rk\"" Jun 09 12:04:08.431017 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.430926 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 12:04:08.437829 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.437793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd"] Jun 09 12:04:08.515359 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.515325 2562 generic.go:356] "Generic (PLEG): container finished" podID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerID="45d22107dddfffb941adb54fa67a61ad448db22298778695c5d794c02cff46f4" exitCode=0 Jun 09 12:04:08.515735 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.515401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" event={"ID":"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9","Type":"ContainerDied","Data":"45d22107dddfffb941adb54fa67a61ad448db22298778695c5d794c02cff46f4"} Jun 09 12:04:08.517702 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.517687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f4fa180-26cb-471a-9177-2a9947899114-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lrhjd\" (UID: \"2f4fa180-26cb-471a-9177-2a9947899114\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" Jun 09 12:04:08.517755 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.517729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qzg4\" (UniqueName: \"kubernetes.io/projected/2f4fa180-26cb-471a-9177-2a9947899114-kube-api-access-8qzg4\") pod \"cert-manager-cainjector-5d99449ffd-lrhjd\" (UID: \"2f4fa180-26cb-471a-9177-2a9947899114\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" Jun 09 12:04:08.618398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.618360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f4fa180-26cb-471a-9177-2a9947899114-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lrhjd\" (UID: \"2f4fa180-26cb-471a-9177-2a9947899114\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" Jun 09 12:04:08.618577 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.618435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qzg4\" (UniqueName: \"kubernetes.io/projected/2f4fa180-26cb-471a-9177-2a9947899114-kube-api-access-8qzg4\") pod \"cert-manager-cainjector-5d99449ffd-lrhjd\" (UID: \"2f4fa180-26cb-471a-9177-2a9947899114\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" Jun 09 12:04:08.627132 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.627101 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f4fa180-26cb-471a-9177-2a9947899114-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lrhjd\" (UID: \"2f4fa180-26cb-471a-9177-2a9947899114\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" Jun 09 12:04:08.627287 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.627265 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qzg4\" (UniqueName: \"kubernetes.io/projected/2f4fa180-26cb-471a-9177-2a9947899114-kube-api-access-8qzg4\") pod \"cert-manager-cainjector-5d99449ffd-lrhjd\" (UID: \"2f4fa180-26cb-471a-9177-2a9947899114\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" Jun 09 12:04:08.747841 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.747728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" Jun 09 12:04:08.876632 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:08.876572 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd"] Jun 09 12:04:08.879383 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:04:08.879350 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f4fa180_26cb_471a_9177_2a9947899114.slice/crio-f3b4fbb6641d67fb61a399723877213f25219be6fd6f2d3c62f003f419cbfad0 WatchSource:0}: Error finding container f3b4fbb6641d67fb61a399723877213f25219be6fd6f2d3c62f003f419cbfad0: Status 404 returned error can't find the container with id f3b4fbb6641d67fb61a399723877213f25219be6fd6f2d3c62f003f419cbfad0 Jun 09 12:04:09.522322 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.522284 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" event={"ID":"2f4fa180-26cb-471a-9177-2a9947899114","Type":"ContainerStarted","Data":"f3b4fbb6641d67fb61a399723877213f25219be6fd6f2d3c62f003f419cbfad0"} Jun 09 12:04:09.649424 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.649401 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:09.726087 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.726059 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-util\") pod \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " Jun 09 12:04:09.726251 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.726122 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbm9m\" (UniqueName: \"kubernetes.io/projected/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-kube-api-access-mbm9m\") pod \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " Jun 09 12:04:09.726251 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.726161 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-bundle\") pod \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\" (UID: \"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9\") " Jun 09 12:04:09.726601 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.726573 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-bundle" (OuterVolumeSpecName: "bundle") pod "5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" (UID: "5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:04:09.728226 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.728200 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-kube-api-access-mbm9m" (OuterVolumeSpecName: "kube-api-access-mbm9m") pod "5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" (UID: "5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9"). InnerVolumeSpecName "kube-api-access-mbm9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:04:09.731794 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.731774 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-util" (OuterVolumeSpecName: "util") pod "5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" (UID: "5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:04:09.826769 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.826687 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbm9m\" (UniqueName: \"kubernetes.io/projected/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-kube-api-access-mbm9m\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:04:09.826769 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.826718 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:04:09.826769 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:09.826729 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:04:10.534697 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:10.534661 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" event={"ID":"5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9","Type":"ContainerDied","Data":"c317beb2ebab922b917fc2a0a61b6dd3e6c9f156c0931383a2286a2d5e4867f9"} Jun 09 12:04:10.534697 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:10.534687 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flngrl" Jun 09 12:04:10.535243 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:10.534716 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c317beb2ebab922b917fc2a0a61b6dd3e6c9f156c0931383a2286a2d5e4867f9" Jun 09 12:04:12.546906 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:12.546795 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" event={"ID":"2f4fa180-26cb-471a-9177-2a9947899114","Type":"ContainerStarted","Data":"ff0d0990dc60101608b2b47e4268d112228a80d95fbc212d3c08bb50f7012de3"} Jun 09 12:04:12.565242 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:12.565187 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lrhjd" podStartSLOduration=1.209159891 podStartE2EDuration="4.565171125s" totalImagesPullingTime="3.356011234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:12.564083419 +0000 UTC m=+537.436346412" watchObservedRunningTime="2026-06-09 12:04:12.565171125 +0000 UTC m=+537.437434112" Jun 09 12:04:22.625162 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.625122 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9"] Jun 09 12:04:22.625639 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.625568 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerName="pull" Jun 09 12:04:22.625639 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.625587 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerName="pull" Jun 09 12:04:22.625639 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.625616 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerName="util" Jun 09 12:04:22.625639 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.625623 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerName="util" Jun 09 12:04:22.625639 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.625640 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerName="extract" Jun 09 12:04:22.625924 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.625648 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerName="extract" Jun 09 12:04:22.625924 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.625754 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e985cc3-1f6d-4ef8-b9f6-d5cb67e3bfc9" containerName="extract" Jun 09 12:04:22.648024 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.647993 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9"] Jun 09 12:04:22.648173 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.648108 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.650860 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.650833 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:04:22.650997 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.650979 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gbmwp\"" Jun 09 12:04:22.651664 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.651649 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:04:22.736108 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.736074 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4drt\" (UniqueName: \"kubernetes.io/projected/583d81bd-aef2-4219-8b66-94425ca23efc-kube-api-access-m4drt\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.736108 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.736119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.736318 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.736139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.836885 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.836854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.836885 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.836893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.837123 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.837011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4drt\" (UniqueName: \"kubernetes.io/projected/583d81bd-aef2-4219-8b66-94425ca23efc-kube-api-access-m4drt\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.837323 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.837298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.837386 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.837322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.846302 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.846274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4drt\" (UniqueName: \"kubernetes.io/projected/583d81bd-aef2-4219-8b66-94425ca23efc-kube-api-access-m4drt\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:22.958108 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:22.958074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:23.106555 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:23.106531 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9"] Jun 09 12:04:23.108779 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:04:23.108751 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583d81bd_aef2_4219_8b66_94425ca23efc.slice/crio-db0314eeb8cf3431a590f629e4157efca735f83fa28d3fcea56edd95ad4f9985 WatchSource:0}: Error finding container db0314eeb8cf3431a590f629e4157efca735f83fa28d3fcea56edd95ad4f9985: Status 404 returned error can't find the container with id db0314eeb8cf3431a590f629e4157efca735f83fa28d3fcea56edd95ad4f9985 Jun 09 12:04:23.593110 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:23.593023 2562 generic.go:356] "Generic (PLEG): container finished" podID="583d81bd-aef2-4219-8b66-94425ca23efc" containerID="fea0d90966c6e077b31ab92b8c026377a6f1f5f882d5a026ac668be7ae4a8f74" exitCode=0 Jun 09 12:04:23.593110 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:23.593086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" event={"ID":"583d81bd-aef2-4219-8b66-94425ca23efc","Type":"ContainerDied","Data":"fea0d90966c6e077b31ab92b8c026377a6f1f5f882d5a026ac668be7ae4a8f74"} Jun 09 12:04:23.593298 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:23.593124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" event={"ID":"583d81bd-aef2-4219-8b66-94425ca23efc","Type":"ContainerStarted","Data":"db0314eeb8cf3431a590f629e4157efca735f83fa28d3fcea56edd95ad4f9985"} Jun 09 12:04:25.603191 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:25.603154 2562 generic.go:356] "Generic (PLEG): container finished" podID="583d81bd-aef2-4219-8b66-94425ca23efc" containerID="8093bc78d4dc8a5f1ac77f836770f1535d863754a11241e582926f548fef9db8" exitCode=0 Jun 09 12:04:25.603659 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:25.603221 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" event={"ID":"583d81bd-aef2-4219-8b66-94425ca23efc","Type":"ContainerDied","Data":"8093bc78d4dc8a5f1ac77f836770f1535d863754a11241e582926f548fef9db8"} Jun 09 12:04:26.609827 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:26.609776 2562 generic.go:356] "Generic (PLEG): container finished" podID="583d81bd-aef2-4219-8b66-94425ca23efc" containerID="3d3c32fd03883a0c5db243a0362653d5ff9e71bff782ff867f8ab3a835b71cdd" exitCode=0 Jun 09 12:04:26.610234 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:26.609850 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" event={"ID":"583d81bd-aef2-4219-8b66-94425ca23efc","Type":"ContainerDied","Data":"3d3c32fd03883a0c5db243a0362653d5ff9e71bff782ff867f8ab3a835b71cdd"} Jun 09 12:04:27.742406 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.742382 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:27.785063 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.785034 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-bundle\") pod \"583d81bd-aef2-4219-8b66-94425ca23efc\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " Jun 09 12:04:27.785236 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.785083 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4drt\" (UniqueName: \"kubernetes.io/projected/583d81bd-aef2-4219-8b66-94425ca23efc-kube-api-access-m4drt\") pod \"583d81bd-aef2-4219-8b66-94425ca23efc\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " Jun 09 12:04:27.785236 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.785193 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-util\") pod \"583d81bd-aef2-4219-8b66-94425ca23efc\" (UID: \"583d81bd-aef2-4219-8b66-94425ca23efc\") " Jun 09 12:04:27.785948 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.785918 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-bundle" (OuterVolumeSpecName: "bundle") pod "583d81bd-aef2-4219-8b66-94425ca23efc" (UID: "583d81bd-aef2-4219-8b66-94425ca23efc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:04:27.787240 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.787218 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/583d81bd-aef2-4219-8b66-94425ca23efc-kube-api-access-m4drt" (OuterVolumeSpecName: "kube-api-access-m4drt") pod "583d81bd-aef2-4219-8b66-94425ca23efc" (UID: "583d81bd-aef2-4219-8b66-94425ca23efc"). InnerVolumeSpecName "kube-api-access-m4drt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:04:27.790761 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.790741 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-util" (OuterVolumeSpecName: "util") pod "583d81bd-aef2-4219-8b66-94425ca23efc" (UID: "583d81bd-aef2-4219-8b66-94425ca23efc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:04:27.886168 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.886077 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4drt\" (UniqueName: \"kubernetes.io/projected/583d81bd-aef2-4219-8b66-94425ca23efc-kube-api-access-m4drt\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:04:27.886168 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.886118 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:04:27.886168 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:27.886129 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583d81bd-aef2-4219-8b66-94425ca23efc-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:04:28.621324 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:28.621296 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" Jun 09 12:04:28.621484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:28.621295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmbkj9" event={"ID":"583d81bd-aef2-4219-8b66-94425ca23efc","Type":"ContainerDied","Data":"db0314eeb8cf3431a590f629e4157efca735f83fa28d3fcea56edd95ad4f9985"} Jun 09 12:04:28.621484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:28.621427 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db0314eeb8cf3431a590f629e4157efca735f83fa28d3fcea56edd95ad4f9985" Jun 09 12:04:40.504278 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.504245 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8"] Jun 09 12:04:40.504648 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.504543 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583d81bd-aef2-4219-8b66-94425ca23efc" containerName="util" Jun 09 12:04:40.504648 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.504553 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="583d81bd-aef2-4219-8b66-94425ca23efc" containerName="util" Jun 09 12:04:40.504648 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.504574 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583d81bd-aef2-4219-8b66-94425ca23efc" containerName="pull" Jun 09 12:04:40.504648 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.504579 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="583d81bd-aef2-4219-8b66-94425ca23efc" containerName="pull" Jun 09 12:04:40.504648 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.504587 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583d81bd-aef2-4219-8b66-94425ca23efc" containerName="extract" Jun 09 12:04:40.504648 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.504593 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="583d81bd-aef2-4219-8b66-94425ca23efc" containerName="extract" Jun 09 12:04:40.504648 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.504648 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="583d81bd-aef2-4219-8b66-94425ca23efc" containerName="extract" Jun 09 12:04:40.506728 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.506712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.511472 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.511452 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 12:04:40.511576 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.511480 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 12:04:40.513018 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.512782 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nf72c\"" Jun 09 12:04:40.513018 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.512879 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 12:04:40.513144 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.513014 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 12:04:40.527657 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.527637 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8"] Jun 09 12:04:40.599106 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.599073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/85eda9fa-3354-48d9-bdf5-b32e6765e958-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.599260 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.599131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85eda9fa-3354-48d9-bdf5-b32e6765e958-tmp\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.599260 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.599171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85eda9fa-3354-48d9-bdf5-b32e6765e958-webhook-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.599260 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.599209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/85eda9fa-3354-48d9-bdf5-b32e6765e958-manifests\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.599260 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.599235 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5lkw\" (UniqueName: \"kubernetes.io/projected/85eda9fa-3354-48d9-bdf5-b32e6765e958-kube-api-access-m5lkw\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.700128 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.700095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/85eda9fa-3354-48d9-bdf5-b32e6765e958-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.700306 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.700157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85eda9fa-3354-48d9-bdf5-b32e6765e958-tmp\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.700306 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.700179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85eda9fa-3354-48d9-bdf5-b32e6765e958-webhook-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.700306 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.700200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/85eda9fa-3354-48d9-bdf5-b32e6765e958-manifests\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.700306 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.700222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5lkw\" (UniqueName: \"kubernetes.io/projected/85eda9fa-3354-48d9-bdf5-b32e6765e958-kube-api-access-m5lkw\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.700645 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.700624 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/85eda9fa-3354-48d9-bdf5-b32e6765e958-manifests\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.702484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.702460 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85eda9fa-3354-48d9-bdf5-b32e6765e958-tmp\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.702709 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.702690 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/85eda9fa-3354-48d9-bdf5-b32e6765e958-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.702778 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.702724 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85eda9fa-3354-48d9-bdf5-b32e6765e958-webhook-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.713175 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.713145 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5lkw\" (UniqueName: \"kubernetes.io/projected/85eda9fa-3354-48d9-bdf5-b32e6765e958-kube-api-access-m5lkw\") pod \"opendatahub-operator-controller-manager-86976b546f-66bm8\" (UID: \"85eda9fa-3354-48d9-bdf5-b32e6765e958\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.816585 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.816505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:40.953243 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:40.953219 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8"] Jun 09 12:04:40.955232 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:04:40.955205 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85eda9fa_3354_48d9_bdf5_b32e6765e958.slice/crio-46fbc419554313f7fe0b240cbb1d93911e36cf67723e0dd9dcc6e0f5a33c5e88 WatchSource:0}: Error finding container 46fbc419554313f7fe0b240cbb1d93911e36cf67723e0dd9dcc6e0f5a33c5e88: Status 404 returned error can't find the container with id 46fbc419554313f7fe0b240cbb1d93911e36cf67723e0dd9dcc6e0f5a33c5e88 Jun 09 12:04:41.684059 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:41.684019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" event={"ID":"85eda9fa-3354-48d9-bdf5-b32e6765e958","Type":"ContainerStarted","Data":"46fbc419554313f7fe0b240cbb1d93911e36cf67723e0dd9dcc6e0f5a33c5e88"} Jun 09 12:04:44.703544 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:44.703512 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" event={"ID":"85eda9fa-3354-48d9-bdf5-b32e6765e958","Type":"ContainerStarted","Data":"7788a50923016ea0131b659dd0c1265717d52d507bb0b7bf92a4235ac66b79ab"} Jun 09 12:04:45.708833 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:45.708783 2562 generic.go:356] "Generic (PLEG): container finished" podID="85eda9fa-3354-48d9-bdf5-b32e6765e958" containerID="7788a50923016ea0131b659dd0c1265717d52d507bb0b7bf92a4235ac66b79ab" exitCode=0 Jun 09 12:04:45.709201 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:45.708864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" event={"ID":"85eda9fa-3354-48d9-bdf5-b32e6765e958","Type":"ContainerDied","Data":"7788a50923016ea0131b659dd0c1265717d52d507bb0b7bf92a4235ac66b79ab"} Jun 09 12:04:46.715446 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:46.715408 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" event={"ID":"85eda9fa-3354-48d9-bdf5-b32e6765e958","Type":"ContainerStarted","Data":"f5ba9e672135e9abfce6d686a5151d71ad96a32b47b5d9efb1392d9b532b1072"} Jun 09 12:04:46.715876 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:46.715516 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:04:46.758855 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:46.758780 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" podStartSLOduration=2.63691747 podStartE2EDuration="6.7587643s" totalImagesPullingTime="3.179947944s" totalInitContainerRuntime="941.898886ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:04:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:46.755723728 +0000 UTC m=+571.627986727" watchObservedRunningTime="2026-06-09 12:04:46.7587643 +0000 UTC m=+571.631027288" Jun 09 12:04:57.729115 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:04:57.729082 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-66bm8" Jun 09 12:05:00.267285 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.267246 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp"] Jun 09 12:05:00.275388 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.275364 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.280217 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.280196 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 12:05:00.280562 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.280543 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lnh2f\"" Jun 09 12:05:00.280992 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.280968 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 12:05:00.286093 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.286072 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp"] Jun 09 12:05:00.365896 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.365862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mlxl\" (UniqueName: \"kubernetes.io/projected/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-kube-api-access-6mlxl\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.366105 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.365915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-tls-certs\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.366105 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.365986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-tmp\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.466451 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.466414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-tls-certs\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.466660 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.466462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-tmp\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.466660 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.466501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mlxl\" (UniqueName: \"kubernetes.io/projected/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-kube-api-access-6mlxl\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.466660 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:00.466584 2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 09 12:05:00.466860 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:00.466679 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-tls-certs podName:61acf8bc-bb39-4c2d-a3ee-a69958079c1f nodeName:}" failed. No retries permitted until 2026-06-09 12:05:00.966656002 +0000 UTC m=+585.838918983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-tls-certs") pod "kube-auth-proxy-6fd697648d-lpvwp" (UID: "61acf8bc-bb39-4c2d-a3ee-a69958079c1f") : secret "kube-auth-proxy-tls" not found Jun 09 12:05:00.468767 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.468747 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-tmp\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.487679 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.487650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mlxl\" (UniqueName: \"kubernetes.io/projected/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-kube-api-access-6mlxl\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.663663 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.663628 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ngr7w"] Jun 09 12:05:00.667060 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.667044 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:00.667753 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.667727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ds8d\" (UniqueName: \"kubernetes.io/projected/9ae8c206-b699-464a-8c38-415d074fe591-kube-api-access-9ds8d\") pod \"odh-model-controller-6dc94f689f-ngr7w\" (UID: \"9ae8c206-b699-464a-8c38-415d074fe591\") " pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:00.667830 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.667786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ae8c206-b699-464a-8c38-415d074fe591-cert\") pod \"odh-model-controller-6dc94f689f-ngr7w\" (UID: \"9ae8c206-b699-464a-8c38-415d074fe591\") " pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:00.676824 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.676788 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 12:05:00.676950 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.676912 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nzrzc\"" Jun 09 12:05:00.687689 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.687664 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ngr7w"] Jun 09 12:05:00.768757 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.768728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ae8c206-b699-464a-8c38-415d074fe591-cert\") pod \"odh-model-controller-6dc94f689f-ngr7w\" (UID: \"9ae8c206-b699-464a-8c38-415d074fe591\") " pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:00.768925 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.768831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ds8d\" (UniqueName: \"kubernetes.io/projected/9ae8c206-b699-464a-8c38-415d074fe591-kube-api-access-9ds8d\") pod \"odh-model-controller-6dc94f689f-ngr7w\" (UID: \"9ae8c206-b699-464a-8c38-415d074fe591\") " pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:00.768925 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:00.768889 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 12:05:00.769013 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:00.768952 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae8c206-b699-464a-8c38-415d074fe591-cert podName:9ae8c206-b699-464a-8c38-415d074fe591 nodeName:}" failed. No retries permitted until 2026-06-09 12:05:01.268936403 +0000 UTC m=+586.141199370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ae8c206-b699-464a-8c38-415d074fe591-cert") pod "odh-model-controller-6dc94f689f-ngr7w" (UID: "9ae8c206-b699-464a-8c38-415d074fe591") : secret "odh-model-controller-webhook-cert" not found Jun 09 12:05:00.781641 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.781616 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ds8d\" (UniqueName: \"kubernetes.io/projected/9ae8c206-b699-464a-8c38-415d074fe591-kube-api-access-9ds8d\") pod \"odh-model-controller-6dc94f689f-ngr7w\" (UID: \"9ae8c206-b699-464a-8c38-415d074fe591\") " pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:00.970483 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.970386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-tls-certs\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:00.972754 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:00.972722 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61acf8bc-bb39-4c2d-a3ee-a69958079c1f-tls-certs\") pod \"kube-auth-proxy-6fd697648d-lpvwp\" (UID: \"61acf8bc-bb39-4c2d-a3ee-a69958079c1f\") " pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:01.186101 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.186061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" Jun 09 12:05:01.273458 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.273425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ae8c206-b699-464a-8c38-415d074fe591-cert\") pod \"odh-model-controller-6dc94f689f-ngr7w\" (UID: \"9ae8c206-b699-464a-8c38-415d074fe591\") " pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:01.275784 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.275758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ae8c206-b699-464a-8c38-415d074fe591-cert\") pod \"odh-model-controller-6dc94f689f-ngr7w\" (UID: \"9ae8c206-b699-464a-8c38-415d074fe591\") " pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:01.277645 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.277619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:01.329484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.329376 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp"] Jun 09 12:05:01.332577 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:01.332543 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61acf8bc_bb39_4c2d_a3ee_a69958079c1f.slice/crio-5f8483e0009088808b1d601a06686ab5c11002d408deef565c796f98123f8223 WatchSource:0}: Error finding container 5f8483e0009088808b1d601a06686ab5c11002d408deef565c796f98123f8223: Status 404 returned error can't find the container with id 5f8483e0009088808b1d601a06686ab5c11002d408deef565c796f98123f8223 Jun 09 12:05:01.356364 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.356333 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-7sbkl"] Jun 09 12:05:01.361071 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.361045 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:01.363567 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.363543 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 12:05:01.374188 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.373963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j54jp\" (UniqueName: \"kubernetes.io/projected/3e9772f9-c89f-4d0b-8a4b-76db506014ad-kube-api-access-j54jp\") pod \"model-serving-api-5dd488fc48-7sbkl\" (UID: \"3e9772f9-c89f-4d0b-8a4b-76db506014ad\") " pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:01.374188 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.374113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9772f9-c89f-4d0b-8a4b-76db506014ad-tls-certs\") pod \"model-serving-api-5dd488fc48-7sbkl\" (UID: \"3e9772f9-c89f-4d0b-8a4b-76db506014ad\") " pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:01.375677 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.375623 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-7sbkl"] Jun 09 12:05:01.427800 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.427774 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ngr7w"] Jun 09 12:05:01.430206 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:01.430179 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae8c206_b699_464a_8c38_415d074fe591.slice/crio-50e6ef49f57a8843be53b92e96befc2c98a3e789d23f9312169cc05f3ba295c2 WatchSource:0}: Error finding container 50e6ef49f57a8843be53b92e96befc2c98a3e789d23f9312169cc05f3ba295c2: Status 404 returned error can't find the container with id 50e6ef49f57a8843be53b92e96befc2c98a3e789d23f9312169cc05f3ba295c2 Jun 09 12:05:01.475371 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.475337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j54jp\" (UniqueName: \"kubernetes.io/projected/3e9772f9-c89f-4d0b-8a4b-76db506014ad-kube-api-access-j54jp\") pod \"model-serving-api-5dd488fc48-7sbkl\" (UID: \"3e9772f9-c89f-4d0b-8a4b-76db506014ad\") " pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:01.475536 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.475405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9772f9-c89f-4d0b-8a4b-76db506014ad-tls-certs\") pod \"model-serving-api-5dd488fc48-7sbkl\" (UID: \"3e9772f9-c89f-4d0b-8a4b-76db506014ad\") " pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:01.475577 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:01.475540 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 12:05:01.475621 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:01.475609 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9772f9-c89f-4d0b-8a4b-76db506014ad-tls-certs podName:3e9772f9-c89f-4d0b-8a4b-76db506014ad nodeName:}" failed. No retries permitted until 2026-06-09 12:05:01.975583754 +0000 UTC m=+586.847846730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3e9772f9-c89f-4d0b-8a4b-76db506014ad-tls-certs") pod "model-serving-api-5dd488fc48-7sbkl" (UID: "3e9772f9-c89f-4d0b-8a4b-76db506014ad") : secret "model-serving-api-tls" not found Jun 09 12:05:01.485030 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.484997 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j54jp\" (UniqueName: \"kubernetes.io/projected/3e9772f9-c89f-4d0b-8a4b-76db506014ad-kube-api-access-j54jp\") pod \"model-serving-api-5dd488fc48-7sbkl\" (UID: \"3e9772f9-c89f-4d0b-8a4b-76db506014ad\") " pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:01.791835 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.791773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" event={"ID":"61acf8bc-bb39-4c2d-a3ee-a69958079c1f","Type":"ContainerStarted","Data":"5f8483e0009088808b1d601a06686ab5c11002d408deef565c796f98123f8223"} Jun 09 12:05:01.792745 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.792723 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" event={"ID":"9ae8c206-b699-464a-8c38-415d074fe591","Type":"ContainerStarted","Data":"50e6ef49f57a8843be53b92e96befc2c98a3e789d23f9312169cc05f3ba295c2"} Jun 09 12:05:01.978608 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.978572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9772f9-c89f-4d0b-8a4b-76db506014ad-tls-certs\") pod \"model-serving-api-5dd488fc48-7sbkl\" (UID: \"3e9772f9-c89f-4d0b-8a4b-76db506014ad\") " pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:01.981466 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:01.981438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9772f9-c89f-4d0b-8a4b-76db506014ad-tls-certs\") pod \"model-serving-api-5dd488fc48-7sbkl\" (UID: \"3e9772f9-c89f-4d0b-8a4b-76db506014ad\") " pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:02.188527 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.188489 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw"] Jun 09 12:05:02.192460 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.192419 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.195158 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.195070 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:05:02.195500 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.195320 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gbmwp\"" Jun 09 12:05:02.196065 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.196016 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:05:02.202387 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.202325 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw"] Jun 09 12:05:02.275101 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.275055 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:02.280528 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.280317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.280528 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.280396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n57rd\" (UniqueName: \"kubernetes.io/projected/b80a9fe1-589b-4cf6-afca-a6cd37fea833-kube-api-access-n57rd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.280528 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.280453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.381617 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.381581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.381773 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.381683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n57rd\" (UniqueName: \"kubernetes.io/projected/b80a9fe1-589b-4cf6-afca-a6cd37fea833-kube-api-access-n57rd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.381773 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.381746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.382669 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.382281 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.382669 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.382296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.401091 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.400710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n57rd\" (UniqueName: \"kubernetes.io/projected/b80a9fe1-589b-4cf6-afca-a6cd37fea833-kube-api-access-n57rd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.508168 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.508083 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:02.707862 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.707827 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-7sbkl"] Jun 09 12:05:02.713402 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.712807 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw"] Jun 09 12:05:02.713402 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:02.712936 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9772f9_c89f_4d0b_8a4b_76db506014ad.slice/crio-e57d07c54da2457cb893494f6601ed1a5e1237553d61957cb811fabc7e8bcbd4 WatchSource:0}: Error finding container e57d07c54da2457cb893494f6601ed1a5e1237553d61957cb811fabc7e8bcbd4: Status 404 returned error can't find the container with id e57d07c54da2457cb893494f6601ed1a5e1237553d61957cb811fabc7e8bcbd4 Jun 09 12:05:02.719930 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:02.719456 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80a9fe1_589b_4cf6_afca_a6cd37fea833.slice/crio-423860d8f7172e3436356b365b843f00f3c285839c53c59539bbf031fb6e93a3 WatchSource:0}: Error finding container 423860d8f7172e3436356b365b843f00f3c285839c53c59539bbf031fb6e93a3: Status 404 returned error can't find the container with id 423860d8f7172e3436356b365b843f00f3c285839c53c59539bbf031fb6e93a3 Jun 09 12:05:02.804210 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.804113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" event={"ID":"3e9772f9-c89f-4d0b-8a4b-76db506014ad","Type":"ContainerStarted","Data":"e57d07c54da2457cb893494f6601ed1a5e1237553d61957cb811fabc7e8bcbd4"} Jun 09 12:05:02.808314 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:02.808240 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" event={"ID":"b80a9fe1-589b-4cf6-afca-a6cd37fea833","Type":"ContainerStarted","Data":"423860d8f7172e3436356b365b843f00f3c285839c53c59539bbf031fb6e93a3"} Jun 09 12:05:03.815263 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:03.815220 2562 generic.go:356] "Generic (PLEG): container finished" podID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerID="c399949f1f35e67b7d87d5212e364580d8b261a3a0617dce5c657bfa34e475ca" exitCode=0 Jun 09 12:05:03.815726 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:03.815285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" event={"ID":"b80a9fe1-589b-4cf6-afca-a6cd37fea833","Type":"ContainerDied","Data":"c399949f1f35e67b7d87d5212e364580d8b261a3a0617dce5c657bfa34e475ca"} Jun 09 12:05:06.833779 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:06.833733 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" event={"ID":"61acf8bc-bb39-4c2d-a3ee-a69958079c1f","Type":"ContainerStarted","Data":"e05d974ea14a1d61f3199db36daa896c69483b65baeb56f5a7488541eafa8ba3"} Jun 09 12:05:06.835249 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:06.835219 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" event={"ID":"9ae8c206-b699-464a-8c38-415d074fe591","Type":"ContainerStarted","Data":"191acff1dddd02da073cb80a2c40fdf6d938451720c412a99cdcd1a92181ab13"} Jun 09 12:05:06.835379 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:06.835279 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:06.837013 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:06.836992 2562 generic.go:356] "Generic (PLEG): container finished" podID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerID="30d98e90865041280ed59892d9b5ed4922e552e5b857378e0050ce5e44cbd17b" exitCode=0 Jun 09 12:05:06.837103 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:06.837079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" event={"ID":"b80a9fe1-589b-4cf6-afca-a6cd37fea833","Type":"ContainerDied","Data":"30d98e90865041280ed59892d9b5ed4922e552e5b857378e0050ce5e44cbd17b"} Jun 09 12:05:06.838565 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:06.838503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" event={"ID":"3e9772f9-c89f-4d0b-8a4b-76db506014ad","Type":"ContainerStarted","Data":"998a69af602f3092cf5f6ac888807fb2485f4e796543b770729c8f0526382d72"} Jun 09 12:05:06.838655 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:06.838640 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:06.894453 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:06.894406 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fd697648d-lpvwp" podStartSLOduration=2.121933677 podStartE2EDuration="6.894390943s" totalImagesPullingTime="4.772457266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:06.893428276 +0000 UTC m=+591.765691263" watchObservedRunningTime="2026-06-09 12:05:06.894390943 +0000 UTC m=+591.766653988" Jun 09 12:05:06.995789 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:06.995726 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" podStartSLOduration=2.7874428350000002 podStartE2EDuration="6.995710356s" totalImagesPullingTime="4.208267521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:06.995144558 +0000 UTC m=+591.867407546" watchObservedRunningTime="2026-06-09 12:05:06.995710356 +0000 UTC m=+591.867973343" Jun 09 12:05:07.036413 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:07.036345 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" podStartSLOduration=2.637670826 podStartE2EDuration="6.036321002s" totalImagesPullingTime="3.398650176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:07.034127315 +0000 UTC m=+591.906390319" watchObservedRunningTime="2026-06-09 12:05:07.036321002 +0000 UTC m=+591.908583990" Jun 09 12:05:07.851520 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:07.851484 2562 generic.go:356] "Generic (PLEG): container finished" podID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerID="2055347b611dfc392aee6ccaa15345b60be791f6272b31dbc66249a50be4a5f9" exitCode=0 Jun 09 12:05:07.851973 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:07.851563 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" event={"ID":"b80a9fe1-589b-4cf6-afca-a6cd37fea833","Type":"ContainerDied","Data":"2055347b611dfc392aee6ccaa15345b60be791f6272b31dbc66249a50be4a5f9"} Jun 09 12:05:08.987757 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:08.987720 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:09.039717 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.039667 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-bundle\") pod \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " Jun 09 12:05:09.039933 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.039753 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-util\") pod \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " Jun 09 12:05:09.039933 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.039856 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n57rd\" (UniqueName: \"kubernetes.io/projected/b80a9fe1-589b-4cf6-afca-a6cd37fea833-kube-api-access-n57rd\") pod \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\" (UID: \"b80a9fe1-589b-4cf6-afca-a6cd37fea833\") " Jun 09 12:05:09.040643 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.040609 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-bundle" (OuterVolumeSpecName: "bundle") pod "b80a9fe1-589b-4cf6-afca-a6cd37fea833" (UID: "b80a9fe1-589b-4cf6-afca-a6cd37fea833"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:05:09.042374 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.042339 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80a9fe1-589b-4cf6-afca-a6cd37fea833-kube-api-access-n57rd" (OuterVolumeSpecName: "kube-api-access-n57rd") pod "b80a9fe1-589b-4cf6-afca-a6cd37fea833" (UID: "b80a9fe1-589b-4cf6-afca-a6cd37fea833"). InnerVolumeSpecName "kube-api-access-n57rd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:05:09.044568 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.044543 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-util" (OuterVolumeSpecName: "util") pod "b80a9fe1-589b-4cf6-afca-a6cd37fea833" (UID: "b80a9fe1-589b-4cf6-afca-a6cd37fea833"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:05:09.141086 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.140996 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:05:09.141086 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.141026 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80a9fe1-589b-4cf6-afca-a6cd37fea833-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:05:09.141086 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.141037 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n57rd\" (UniqueName: \"kubernetes.io/projected/b80a9fe1-589b-4cf6-afca-a6cd37fea833-kube-api-access-n57rd\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:05:09.863539 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.863457 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" Jun 09 12:05:09.863691 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.863450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06r2xmw" event={"ID":"b80a9fe1-589b-4cf6-afca-a6cd37fea833","Type":"ContainerDied","Data":"423860d8f7172e3436356b365b843f00f3c285839c53c59539bbf031fb6e93a3"} Jun 09 12:05:09.863691 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:09.863573 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="423860d8f7172e3436356b365b843f00f3c285839c53c59539bbf031fb6e93a3" Jun 09 12:05:11.303085 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.303049 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-fwmxk"] Jun 09 12:05:11.303484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.303411 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerName="extract" Jun 09 12:05:11.303484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.303422 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerName="extract" Jun 09 12:05:11.303484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.303434 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerName="util" Jun 09 12:05:11.303484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.303440 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerName="util" Jun 09 12:05:11.303484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.303456 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerName="pull" Jun 09 12:05:11.303484 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.303461 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerName="pull" Jun 09 12:05:11.303682 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.303515 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80a9fe1-589b-4cf6-afca-a6cd37fea833" containerName="extract" Jun 09 12:05:11.306661 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.306640 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:11.309911 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.309891 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 12:05:11.310145 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.310130 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5j5nj\"" Jun 09 12:05:11.318292 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.318270 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-fwmxk"] Jun 09 12:05:11.322089 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.322065 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7"] Jun 09 12:05:11.325151 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.325132 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:11.327784 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.327765 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 12:05:11.328176 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.328156 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kk6d6\"" Jun 09 12:05:11.336914 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.336890 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7"] Jun 09 12:05:11.359552 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.359516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6fhr\" (UniqueName: \"kubernetes.io/projected/1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22-kube-api-access-d6fhr\") pod \"llmisvc-controller-manager-864bfd7bc9-5hpz7\" (UID: \"1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:11.359738 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.359563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxwlv\" (UniqueName: \"kubernetes.io/projected/1285b0b5-215d-4cf4-ae7f-6eb419e84dbc-kube-api-access-bxwlv\") pod \"kserve-controller-manager-69fc866d76-fwmxk\" (UID: \"1285b0b5-215d-4cf4-ae7f-6eb419e84dbc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:11.359738 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.359610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1285b0b5-215d-4cf4-ae7f-6eb419e84dbc-cert\") pod \"kserve-controller-manager-69fc866d76-fwmxk\" (UID: \"1285b0b5-215d-4cf4-ae7f-6eb419e84dbc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:11.359738 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.359662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5hpz7\" (UID: \"1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:11.461056 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.460997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6fhr\" (UniqueName: \"kubernetes.io/projected/1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22-kube-api-access-d6fhr\") pod \"llmisvc-controller-manager-864bfd7bc9-5hpz7\" (UID: \"1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:11.461218 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.461084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxwlv\" (UniqueName: \"kubernetes.io/projected/1285b0b5-215d-4cf4-ae7f-6eb419e84dbc-kube-api-access-bxwlv\") pod \"kserve-controller-manager-69fc866d76-fwmxk\" (UID: \"1285b0b5-215d-4cf4-ae7f-6eb419e84dbc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:11.461218 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.461121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1285b0b5-215d-4cf4-ae7f-6eb419e84dbc-cert\") pod \"kserve-controller-manager-69fc866d76-fwmxk\" (UID: \"1285b0b5-215d-4cf4-ae7f-6eb419e84dbc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:11.461218 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.461169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5hpz7\" (UID: \"1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:11.461343 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:11.461283 2562 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 09 12:05:11.461343 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:11.461330 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 09 12:05:11.461407 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:11.461352 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1285b0b5-215d-4cf4-ae7f-6eb419e84dbc-cert podName:1285b0b5-215d-4cf4-ae7f-6eb419e84dbc nodeName:}" failed. No retries permitted until 2026-06-09 12:05:11.961336372 +0000 UTC m=+596.833599341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1285b0b5-215d-4cf4-ae7f-6eb419e84dbc-cert") pod "kserve-controller-manager-69fc866d76-fwmxk" (UID: "1285b0b5-215d-4cf4-ae7f-6eb419e84dbc") : secret "kserve-webhook-server-cert" not found Jun 09 12:05:11.461407 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:05:11.461379 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22-cert podName:1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22 nodeName:}" failed. No retries permitted until 2026-06-09 12:05:11.961362532 +0000 UTC m=+596.833625498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22-cert") pod "llmisvc-controller-manager-864bfd7bc9-5hpz7" (UID: "1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22") : secret "llmisvc-webhook-server-cert" not found Jun 09 12:05:11.474495 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.474457 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxwlv\" (UniqueName: \"kubernetes.io/projected/1285b0b5-215d-4cf4-ae7f-6eb419e84dbc-kube-api-access-bxwlv\") pod \"kserve-controller-manager-69fc866d76-fwmxk\" (UID: \"1285b0b5-215d-4cf4-ae7f-6eb419e84dbc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:11.475288 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.475268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6fhr\" (UniqueName: \"kubernetes.io/projected/1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22-kube-api-access-d6fhr\") pod \"llmisvc-controller-manager-864bfd7bc9-5hpz7\" (UID: \"1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:11.965564 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.965520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1285b0b5-215d-4cf4-ae7f-6eb419e84dbc-cert\") pod \"kserve-controller-manager-69fc866d76-fwmxk\" (UID: \"1285b0b5-215d-4cf4-ae7f-6eb419e84dbc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:11.965777 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.965574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5hpz7\" (UID: \"1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:11.968056 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.968034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5hpz7\" (UID: \"1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:11.968146 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:11.968110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1285b0b5-215d-4cf4-ae7f-6eb419e84dbc-cert\") pod \"kserve-controller-manager-69fc866d76-fwmxk\" (UID: \"1285b0b5-215d-4cf4-ae7f-6eb419e84dbc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:12.217547 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:12.217453 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:12.235098 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:12.235067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:12.369398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:12.369218 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-fwmxk"] Jun 09 12:05:12.372406 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:12.372366 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1285b0b5_215d_4cf4_ae7f_6eb419e84dbc.slice/crio-88474f37385d4cd7154f315a55630fab27de1f55638b79e6e8f974777d4a1d2f WatchSource:0}: Error finding container 88474f37385d4cd7154f315a55630fab27de1f55638b79e6e8f974777d4a1d2f: Status 404 returned error can't find the container with id 88474f37385d4cd7154f315a55630fab27de1f55638b79e6e8f974777d4a1d2f Jun 09 12:05:12.385720 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:12.385697 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7"] Jun 09 12:05:12.387787 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:12.387758 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1dcc3b2b_5d0f_4776_bef7_e2cb8527ff22.slice/crio-ee1c7c822635bf03a7ba992f308163d398d2435f7a1ab9184d3bca13e9b28a1b WatchSource:0}: Error finding container ee1c7c822635bf03a7ba992f308163d398d2435f7a1ab9184d3bca13e9b28a1b: Status 404 returned error can't find the container with id ee1c7c822635bf03a7ba992f308163d398d2435f7a1ab9184d3bca13e9b28a1b Jun 09 12:05:12.879413 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:12.879382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" event={"ID":"1285b0b5-215d-4cf4-ae7f-6eb419e84dbc","Type":"ContainerStarted","Data":"88474f37385d4cd7154f315a55630fab27de1f55638b79e6e8f974777d4a1d2f"} Jun 09 12:05:12.886878 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:12.886833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" event={"ID":"1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22","Type":"ContainerStarted","Data":"ee1c7c822635bf03a7ba992f308163d398d2435f7a1ab9184d3bca13e9b28a1b"} Jun 09 12:05:15.685751 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:15.685722 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:05:15.686217 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:15.685758 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:05:15.905471 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:15.905429 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" event={"ID":"1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22","Type":"ContainerStarted","Data":"23cfead26dce4c1feb46ad0bd7662f64fa88dcebbcc60aac81b2763334c6c065"} Jun 09 12:05:15.905664 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:15.905501 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:15.906953 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:15.906929 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" event={"ID":"1285b0b5-215d-4cf4-ae7f-6eb419e84dbc","Type":"ContainerStarted","Data":"885e9523b59f694cbae82885d12a9388bb34ffcb224ef9e6d2affa60dd3da053"} Jun 09 12:05:15.907089 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:15.907055 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:15.952830 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:15.952693 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" podStartSLOduration=1.628036005 podStartE2EDuration="4.952670159s" totalImagesPullingTime="3.324634154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:15.949743798 +0000 UTC m=+600.822006786" watchObservedRunningTime="2026-06-09 12:05:15.952670159 +0000 UTC m=+600.824933148" Jun 09 12:05:15.983865 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:15.983784 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" podStartSLOduration=2.264248843 podStartE2EDuration="4.983767573s" totalImagesPullingTime="2.71951873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:15.983073987 +0000 UTC m=+600.855337000" watchObservedRunningTime="2026-06-09 12:05:15.983767573 +0000 UTC m=+600.856030560" Jun 09 12:05:17.854515 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:17.854482 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-ngr7w" Jun 09 12:05:17.856323 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:17.856297 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-7sbkl" Jun 09 12:05:18.216229 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.216196 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2"] Jun 09 12:05:18.220654 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.220636 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.230866 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.230845 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:05:18.231003 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.230887 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:05:18.231003 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.230988 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gbmwp\"" Jun 09 12:05:18.246709 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.246683 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2"] Jun 09 12:05:18.328351 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.328314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.328526 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.328375 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.328526 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.328445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xw8l\" (UniqueName: \"kubernetes.io/projected/73360ebf-e0a2-4e1d-8c67-d675fa138713-kube-api-access-8xw8l\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.429885 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.429849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.430063 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.429905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.430063 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.429964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xw8l\" (UniqueName: \"kubernetes.io/projected/73360ebf-e0a2-4e1d-8c67-d675fa138713-kube-api-access-8xw8l\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.430308 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.430283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.430375 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.430318 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.483027 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.482952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xw8l\" (UniqueName: \"kubernetes.io/projected/73360ebf-e0a2-4e1d-8c67-d675fa138713-kube-api-access-8xw8l\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.530411 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.530374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:18.758683 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.758654 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2"] Jun 09 12:05:18.761427 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:18.761395 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73360ebf_e0a2_4e1d_8c67_d675fa138713.slice/crio-405a9f8784e4899d305365365f3670169f04e5b7f83d75cf9e3af64acf6fab23 WatchSource:0}: Error finding container 405a9f8784e4899d305365365f3670169f04e5b7f83d75cf9e3af64acf6fab23: Status 404 returned error can't find the container with id 405a9f8784e4899d305365365f3670169f04e5b7f83d75cf9e3af64acf6fab23 Jun 09 12:05:18.925653 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.925619 2562 generic.go:356] "Generic (PLEG): container finished" podID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerID="dda374916ea4bf6332790b47688f7cd236aff19a91cf9d8317303dd46aba55b0" exitCode=0 Jun 09 12:05:18.926122 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.925699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" event={"ID":"73360ebf-e0a2-4e1d-8c67-d675fa138713","Type":"ContainerDied","Data":"dda374916ea4bf6332790b47688f7cd236aff19a91cf9d8317303dd46aba55b0"} Jun 09 12:05:18.926122 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:18.925749 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" event={"ID":"73360ebf-e0a2-4e1d-8c67-d675fa138713","Type":"ContainerStarted","Data":"405a9f8784e4899d305365365f3670169f04e5b7f83d75cf9e3af64acf6fab23"} Jun 09 12:05:20.937307 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:20.937271 2562 generic.go:356] "Generic (PLEG): container finished" podID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerID="9ba8ab1df055d1352c72ee4fedde2d97a6c5f05e78caa99d0d4412cb9f0fb6a5" exitCode=0 Jun 09 12:05:20.937799 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:20.937332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" event={"ID":"73360ebf-e0a2-4e1d-8c67-d675fa138713","Type":"ContainerDied","Data":"9ba8ab1df055d1352c72ee4fedde2d97a6c5f05e78caa99d0d4412cb9f0fb6a5"} Jun 09 12:05:21.944307 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:21.944271 2562 generic.go:356] "Generic (PLEG): container finished" podID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerID="be0f207cb27791e0e8660a8eb3e9d922c60b0c11884e7e25c0642088c9aed67a" exitCode=0 Jun 09 12:05:21.944674 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:21.944320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" event={"ID":"73360ebf-e0a2-4e1d-8c67-d675fa138713","Type":"ContainerDied","Data":"be0f207cb27791e0e8660a8eb3e9d922c60b0c11884e7e25c0642088c9aed67a"} Jun 09 12:05:22.204397 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.204311 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7"] Jun 09 12:05:22.207690 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.207672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:22.213308 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.213283 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 12:05:22.213987 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.213959 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 12:05:22.214176 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.214160 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-pkf9r\"" Jun 09 12:05:22.234694 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.234662 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7"] Jun 09 12:05:22.266726 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.266676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e4644e28-b07d-4e5e-a2b8-bdc7cc70b024-operator-config\") pod \"servicemesh-operator3-57f65f65fb-pqzf7\" (UID: \"e4644e28-b07d-4e5e-a2b8-bdc7cc70b024\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:22.266937 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.266763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2pd\" (UniqueName: \"kubernetes.io/projected/e4644e28-b07d-4e5e-a2b8-bdc7cc70b024-kube-api-access-wp2pd\") pod \"servicemesh-operator3-57f65f65fb-pqzf7\" (UID: \"e4644e28-b07d-4e5e-a2b8-bdc7cc70b024\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:22.367290 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.367251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e4644e28-b07d-4e5e-a2b8-bdc7cc70b024-operator-config\") pod \"servicemesh-operator3-57f65f65fb-pqzf7\" (UID: \"e4644e28-b07d-4e5e-a2b8-bdc7cc70b024\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:22.367439 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.367316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2pd\" (UniqueName: \"kubernetes.io/projected/e4644e28-b07d-4e5e-a2b8-bdc7cc70b024-kube-api-access-wp2pd\") pod \"servicemesh-operator3-57f65f65fb-pqzf7\" (UID: \"e4644e28-b07d-4e5e-a2b8-bdc7cc70b024\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:22.369899 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.369870 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e4644e28-b07d-4e5e-a2b8-bdc7cc70b024-operator-config\") pod \"servicemesh-operator3-57f65f65fb-pqzf7\" (UID: \"e4644e28-b07d-4e5e-a2b8-bdc7cc70b024\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:22.392836 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.392789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2pd\" (UniqueName: \"kubernetes.io/projected/e4644e28-b07d-4e5e-a2b8-bdc7cc70b024-kube-api-access-wp2pd\") pod \"servicemesh-operator3-57f65f65fb-pqzf7\" (UID: \"e4644e28-b07d-4e5e-a2b8-bdc7cc70b024\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:22.518176 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.518081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:22.665141 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.665113 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7"] Jun 09 12:05:22.666646 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:22.666611 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4644e28_b07d_4e5e_a2b8_bdc7cc70b024.slice/crio-853c34e8b51dde3b4a5e3470eac0703b9a4b4eeb0348f8b06a34538ac8aae752 WatchSource:0}: Error finding container 853c34e8b51dde3b4a5e3470eac0703b9a4b4eeb0348f8b06a34538ac8aae752: Status 404 returned error can't find the container with id 853c34e8b51dde3b4a5e3470eac0703b9a4b4eeb0348f8b06a34538ac8aae752 Jun 09 12:05:22.951209 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:22.951168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" event={"ID":"e4644e28-b07d-4e5e-a2b8-bdc7cc70b024","Type":"ContainerStarted","Data":"853c34e8b51dde3b4a5e3470eac0703b9a4b4eeb0348f8b06a34538ac8aae752"} Jun 09 12:05:23.071626 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.071598 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:23.173260 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.173222 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-util\") pod \"73360ebf-e0a2-4e1d-8c67-d675fa138713\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " Jun 09 12:05:23.173438 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.173272 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-bundle\") pod \"73360ebf-e0a2-4e1d-8c67-d675fa138713\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " Jun 09 12:05:23.173438 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.173387 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xw8l\" (UniqueName: \"kubernetes.io/projected/73360ebf-e0a2-4e1d-8c67-d675fa138713-kube-api-access-8xw8l\") pod \"73360ebf-e0a2-4e1d-8c67-d675fa138713\" (UID: \"73360ebf-e0a2-4e1d-8c67-d675fa138713\") " Jun 09 12:05:23.174179 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.174150 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-bundle" (OuterVolumeSpecName: "bundle") pod "73360ebf-e0a2-4e1d-8c67-d675fa138713" (UID: "73360ebf-e0a2-4e1d-8c67-d675fa138713"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:05:23.175413 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.175384 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73360ebf-e0a2-4e1d-8c67-d675fa138713-kube-api-access-8xw8l" (OuterVolumeSpecName: "kube-api-access-8xw8l") pod "73360ebf-e0a2-4e1d-8c67-d675fa138713" (UID: "73360ebf-e0a2-4e1d-8c67-d675fa138713"). InnerVolumeSpecName "kube-api-access-8xw8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:05:23.178796 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.178771 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-util" (OuterVolumeSpecName: "util") pod "73360ebf-e0a2-4e1d-8c67-d675fa138713" (UID: "73360ebf-e0a2-4e1d-8c67-d675fa138713"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:05:23.274197 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.274110 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xw8l\" (UniqueName: \"kubernetes.io/projected/73360ebf-e0a2-4e1d-8c67-d675fa138713-kube-api-access-8xw8l\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:05:23.274197 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.274140 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:05:23.274197 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.274149 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73360ebf-e0a2-4e1d-8c67-d675fa138713-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:05:23.960235 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.960199 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" event={"ID":"73360ebf-e0a2-4e1d-8c67-d675fa138713","Type":"ContainerDied","Data":"405a9f8784e4899d305365365f3670169f04e5b7f83d75cf9e3af64acf6fab23"} Jun 09 12:05:23.960652 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.960255 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="405a9f8784e4899d305365365f3670169f04e5b7f83d75cf9e3af64acf6fab23" Jun 09 12:05:23.960652 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:23.960267 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atlzs2" Jun 09 12:05:25.973496 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:25.973454 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" event={"ID":"e4644e28-b07d-4e5e-a2b8-bdc7cc70b024","Type":"ContainerStarted","Data":"3197c78dd8c3d50a91027401e309af3bdf759bdcf93dc50c18e9011c40ac7801"} Jun 09 12:05:25.973914 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:25.973602 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:26.008075 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:26.008016 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" podStartSLOduration=1.475867158 podStartE2EDuration="4.00800032s" totalImagesPullingTime="2.532133162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:26.006110542 +0000 UTC m=+610.878373531" watchObservedRunningTime="2026-06-09 12:05:26.00800032 +0000 UTC m=+610.880263308" Jun 09 12:05:36.199032 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.198939 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-76df79655d-gxwx5"] Jun 09 12:05:36.199475 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.199422 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerName="pull" Jun 09 12:05:36.199475 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.199439 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerName="pull" Jun 09 12:05:36.199475 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.199459 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerName="util" Jun 09 12:05:36.199475 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.199465 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerName="util" Jun 09 12:05:36.199475 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.199476 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerName="extract" Jun 09 12:05:36.199730 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.199483 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerName="extract" Jun 09 12:05:36.199730 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.199561 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="73360ebf-e0a2-4e1d-8c67-d675fa138713" containerName="extract" Jun 09 12:05:36.261653 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.261617 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76df79655d-gxwx5"] Jun 09 12:05:36.261808 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.261737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" Jun 09 12:05:36.264186 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.264168 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bp824\"" Jun 09 12:05:36.264273 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.264171 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 12:05:36.399749 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.399707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d42c0fe7-f49b-40a1-94ba-dbc2f566efe4-redirect-config\") pod \"dashboard-redirect-76df79655d-gxwx5\" (UID: \"d42c0fe7-f49b-40a1-94ba-dbc2f566efe4\") " pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" Jun 09 12:05:36.399949 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.399769 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5d45\" (UniqueName: \"kubernetes.io/projected/d42c0fe7-f49b-40a1-94ba-dbc2f566efe4-kube-api-access-m5d45\") pod \"dashboard-redirect-76df79655d-gxwx5\" (UID: \"d42c0fe7-f49b-40a1-94ba-dbc2f566efe4\") " pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" Jun 09 12:05:36.500674 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.500591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d42c0fe7-f49b-40a1-94ba-dbc2f566efe4-redirect-config\") pod \"dashboard-redirect-76df79655d-gxwx5\" (UID: \"d42c0fe7-f49b-40a1-94ba-dbc2f566efe4\") " pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" Jun 09 12:05:36.500674 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.500636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5d45\" (UniqueName: \"kubernetes.io/projected/d42c0fe7-f49b-40a1-94ba-dbc2f566efe4-kube-api-access-m5d45\") pod \"dashboard-redirect-76df79655d-gxwx5\" (UID: \"d42c0fe7-f49b-40a1-94ba-dbc2f566efe4\") " pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" Jun 09 12:05:36.501332 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.501313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d42c0fe7-f49b-40a1-94ba-dbc2f566efe4-redirect-config\") pod \"dashboard-redirect-76df79655d-gxwx5\" (UID: \"d42c0fe7-f49b-40a1-94ba-dbc2f566efe4\") " pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" Jun 09 12:05:36.510534 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.510515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5d45\" (UniqueName: \"kubernetes.io/projected/d42c0fe7-f49b-40a1-94ba-dbc2f566efe4-kube-api-access-m5d45\") pod \"dashboard-redirect-76df79655d-gxwx5\" (UID: \"d42c0fe7-f49b-40a1-94ba-dbc2f566efe4\") " pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" Jun 09 12:05:36.572658 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.572623 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" Jun 09 12:05:36.740988 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.740964 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76df79655d-gxwx5"] Jun 09 12:05:36.743256 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:36.743229 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42c0fe7_f49b_40a1_94ba_dbc2f566efe4.slice/crio-946c7f1c11c76ac81e53313fbf77dd93e4eae9516be2b067ffceed1f4563bac6 WatchSource:0}: Error finding container 946c7f1c11c76ac81e53313fbf77dd93e4eae9516be2b067ffceed1f4563bac6: Status 404 returned error can't find the container with id 946c7f1c11c76ac81e53313fbf77dd93e4eae9516be2b067ffceed1f4563bac6 Jun 09 12:05:36.745095 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.745078 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:05:36.981011 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:36.980984 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pqzf7" Jun 09 12:05:37.030742 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:37.030711 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" event={"ID":"d42c0fe7-f49b-40a1-94ba-dbc2f566efe4","Type":"ContainerStarted","Data":"946c7f1c11c76ac81e53313fbf77dd93e4eae9516be2b067ffceed1f4563bac6"} Jun 09 12:05:41.054330 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:41.054291 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" event={"ID":"d42c0fe7-f49b-40a1-94ba-dbc2f566efe4","Type":"ContainerStarted","Data":"467c2542c896c26105ec2ec31f1840d899c85f60d8f6fec0ebfbb0898055b4d4"} Jun 09 12:05:41.075294 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:41.075238 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-76df79655d-gxwx5" podStartSLOduration=1.6108757040000001 podStartE2EDuration="5.075221914s" totalImagesPullingTime="3.46434621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:41.072857611 +0000 UTC m=+625.945120600" watchObservedRunningTime="2026-06-09 12:05:41.075221914 +0000 UTC m=+625.947484940" Jun 09 12:05:46.913975 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:46.913943 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5hpz7" Jun 09 12:05:46.917013 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:46.916992 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-fwmxk" Jun 09 12:05:50.840631 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.840599 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64"] Jun 09 12:05:50.846261 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.846235 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:50.849700 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.849680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 12:05:50.850086 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.850063 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 12:05:50.850178 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.850131 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 12:05:50.850233 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.850187 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 12:05:50.850713 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.850687 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fsb5d\"" Jun 09 12:05:50.875796 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.875762 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64"] Jun 09 12:05:50.934922 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.934886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5f27d741-7ee4-40f6-9990-6d93b721a9be-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:50.934922 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.934924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:50.935168 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.934956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:50.935168 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.934998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f27d741-7ee4-40f6-9990-6d93b721a9be-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:50.935168 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.935036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:50.935168 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.935098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p2fn\" (UniqueName: \"kubernetes.io/projected/5f27d741-7ee4-40f6-9990-6d93b721a9be-kube-api-access-4p2fn\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:50.935343 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:50.935166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.036330 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.036292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.036330 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.036338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2fn\" (UniqueName: \"kubernetes.io/projected/5f27d741-7ee4-40f6-9990-6d93b721a9be-kube-api-access-4p2fn\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.036594 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.036364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.036594 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.036409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5f27d741-7ee4-40f6-9990-6d93b721a9be-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.036594 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.036430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.036594 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.036467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.036594 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.036507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f27d741-7ee4-40f6-9990-6d93b721a9be-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.037214 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.037185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.039103 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.039066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.039213 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.039116 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5f27d741-7ee4-40f6-9990-6d93b721a9be-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.039281 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.039218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f27d741-7ee4-40f6-9990-6d93b721a9be-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.039415 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.039394 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.044770 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.044746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f27d741-7ee4-40f6-9990-6d93b721a9be-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.044914 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.044893 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p2fn\" (UniqueName: \"kubernetes.io/projected/5f27d741-7ee4-40f6-9990-6d93b721a9be-kube-api-access-4p2fn\") pod \"istiod-openshift-gateway-75c67f8887-f6h64\" (UID: \"5f27d741-7ee4-40f6-9990-6d93b721a9be\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.161888 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.161859 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:51.306356 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:51.306325 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64"] Jun 09 12:05:51.308091 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:05:51.308059 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f27d741_7ee4_40f6_9990_6d93b721a9be.slice/crio-b6f805b571b300f2e5cc74f0ed19f5dcb334b06b00633f08158d54318c61b45e WatchSource:0}: Error finding container b6f805b571b300f2e5cc74f0ed19f5dcb334b06b00633f08158d54318c61b45e: Status 404 returned error can't find the container with id b6f805b571b300f2e5cc74f0ed19f5dcb334b06b00633f08158d54318c61b45e Jun 09 12:05:52.114043 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:52.114006 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" event={"ID":"5f27d741-7ee4-40f6-9990-6d93b721a9be","Type":"ContainerStarted","Data":"b6f805b571b300f2e5cc74f0ed19f5dcb334b06b00633f08158d54318c61b45e"} Jun 09 12:05:54.130270 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:54.130231 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 12:05:54.130525 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:54.130302 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 12:05:55.132498 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:55.132458 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" event={"ID":"5f27d741-7ee4-40f6-9990-6d93b721a9be","Type":"ContainerStarted","Data":"0b6e9bcdb03ad44275c4c47cae95b3fcd567bdcb2171cdd5b100ace6183ab6d7"} Jun 09 12:05:55.133013 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:55.132523 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:55.134214 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:55.134190 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" Jun 09 12:05:55.155765 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:05:55.155711 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f6h64" podStartSLOduration=2.336103819 podStartE2EDuration="5.155693278s" totalImagesPullingTime="2.819589459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:55.154178539 +0000 UTC m=+640.026441520" watchObservedRunningTime="2026-06-09 12:05:55.155693278 +0000 UTC m=+640.027956266" Jun 09 12:06:21.144049 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.144010 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56f7799b9c-hffrc"] Jun 09 12:06:21.152013 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.151978 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.158443 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.158406 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f7799b9c-hffrc"] Jun 09 12:06:21.320111 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.320068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-trusted-ca-bundle\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.320280 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.320125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1d29dfb-0be5-4884-95af-ccd7497460b4-console-oauth-config\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.320280 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.320175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-console-config\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.320280 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.320203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-service-ca\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.320280 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.320243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-oauth-serving-cert\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.320280 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.320268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vbpc\" (UniqueName: \"kubernetes.io/projected/f1d29dfb-0be5-4884-95af-ccd7497460b4-kube-api-access-2vbpc\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.320463 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.320311 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d29dfb-0be5-4884-95af-ccd7497460b4-console-serving-cert\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.400048 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.399956 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd"] Jun 09 12:06:21.402796 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.402778 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.405612 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.405586 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:06:21.405764 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.405626 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:06:21.405764 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.405633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vkqf9\"" Jun 09 12:06:21.414244 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.414224 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd"] Jun 09 12:06:21.421397 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.421368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-trusted-ca-bundle\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.421515 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.421432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1d29dfb-0be5-4884-95af-ccd7497460b4-console-oauth-config\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.421515 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.421472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-console-config\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.421611 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.421515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-service-ca\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.421611 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.421538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-oauth-serving-cert\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.421611 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.421570 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vbpc\" (UniqueName: \"kubernetes.io/projected/f1d29dfb-0be5-4884-95af-ccd7497460b4-kube-api-access-2vbpc\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.421765 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.421610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d29dfb-0be5-4884-95af-ccd7497460b4-console-serving-cert\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.422260 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.422233 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-service-ca\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.422382 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.422309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-console-config\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.422382 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.422357 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-oauth-serving-cert\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.422551 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.422522 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d29dfb-0be5-4884-95af-ccd7497460b4-trusted-ca-bundle\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.424327 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.424307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d29dfb-0be5-4884-95af-ccd7497460b4-console-serving-cert\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.424458 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.424437 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1d29dfb-0be5-4884-95af-ccd7497460b4-console-oauth-config\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.433206 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.433184 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vbpc\" (UniqueName: \"kubernetes.io/projected/f1d29dfb-0be5-4884-95af-ccd7497460b4-kube-api-access-2vbpc\") pod \"console-56f7799b9c-hffrc\" (UID: \"f1d29dfb-0be5-4884-95af-ccd7497460b4\") " pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.463314 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.463265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:21.481930 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.481901 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9"] Jun 09 12:06:21.484899 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.484872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.493870 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.493841 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9"] Jun 09 12:06:21.523504 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.523344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.523504 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.523439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trzks\" (UniqueName: \"kubernetes.io/projected/66d76e3c-5923-4d05-9f0e-293e1cd6f822-kube-api-access-trzks\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.523729 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.523693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.613883 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.613853 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f7799b9c-hffrc"] Jun 09 12:06:21.616220 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:06:21.616192 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d29dfb_0be5_4884_95af_ccd7497460b4.slice/crio-254ba44a3e047aff653f46677585197c445b75582a98425e27db0c610bc1df95 WatchSource:0}: Error finding container 254ba44a3e047aff653f46677585197c445b75582a98425e27db0c610bc1df95: Status 404 returned error can't find the container with id 254ba44a3e047aff653f46677585197c445b75582a98425e27db0c610bc1df95 Jun 09 12:06:21.625015 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.624990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.625136 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.625078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.625136 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.625109 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.625258 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.625144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzz26\" (UniqueName: \"kubernetes.io/projected/821a3884-cdb8-4843-a766-6a44dfc4ccce-kube-api-access-dzz26\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.625258 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.625175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trzks\" (UniqueName: \"kubernetes.io/projected/66d76e3c-5923-4d05-9f0e-293e1cd6f822-kube-api-access-trzks\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.625258 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.625226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.625514 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.625492 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.625621 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.625600 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.633861 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.633838 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trzks\" (UniqueName: \"kubernetes.io/projected/66d76e3c-5923-4d05-9f0e-293e1cd6f822-kube-api-access-trzks\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.713269 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.713226 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:21.726298 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.726273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.726397 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.726313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz26\" (UniqueName: \"kubernetes.io/projected/821a3884-cdb8-4843-a766-6a44dfc4ccce-kube-api-access-dzz26\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.726397 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.726359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.726701 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.726677 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.726795 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.726723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.738678 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.738653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzz26\" (UniqueName: \"kubernetes.io/projected/821a3884-cdb8-4843-a766-6a44dfc4ccce-kube-api-access-dzz26\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.782679 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.782632 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r"] Jun 09 12:06:21.786341 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.786315 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:21.795128 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.795105 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r"] Jun 09 12:06:21.798667 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.798644 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:21.861288 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.861244 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd"] Jun 09 12:06:21.865273 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:06:21.865214 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d76e3c_5923_4d05_9f0e_293e1cd6f822.slice/crio-a244d778b362d9e4d412f5e543cd13fba8e3cf71be5759404f17cb73edb6a775 WatchSource:0}: Error finding container a244d778b362d9e4d412f5e543cd13fba8e3cf71be5759404f17cb73edb6a775: Status 404 returned error can't find the container with id a244d778b362d9e4d412f5e543cd13fba8e3cf71be5759404f17cb73edb6a775 Jun 09 12:06:21.927650 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.927578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:21.927796 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.927768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:21.927905 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.927827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4r7w\" (UniqueName: \"kubernetes.io/projected/9cc03229-6e01-4766-956e-4a2b9611d6d5-kube-api-access-m4r7w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:21.951664 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:21.951634 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9"] Jun 09 12:06:21.953505 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:06:21.953472 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821a3884_cdb8_4843_a766_6a44dfc4ccce.slice/crio-3f7a5cd1015fdacda7b7434b20d70aa205e2cfafd282b4adb279ccdd48af13b9 WatchSource:0}: Error finding container 3f7a5cd1015fdacda7b7434b20d70aa205e2cfafd282b4adb279ccdd48af13b9: Status 404 returned error can't find the container with id 3f7a5cd1015fdacda7b7434b20d70aa205e2cfafd282b4adb279ccdd48af13b9 Jun 09 12:06:22.028616 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.028583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:22.028616 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.028618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4r7w\" (UniqueName: \"kubernetes.io/projected/9cc03229-6e01-4766-956e-4a2b9611d6d5-kube-api-access-m4r7w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:22.028856 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.028665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:22.029033 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.029012 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:22.029084 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.029041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:22.036927 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.036903 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4r7w\" (UniqueName: \"kubernetes.io/projected/9cc03229-6e01-4766-956e-4a2b9611d6d5-kube-api-access-m4r7w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:22.097301 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.097266 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:22.184419 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.184378 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq"] Jun 09 12:06:22.187571 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.187544 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.196046 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.196018 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq"] Jun 09 12:06:22.239098 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.239075 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r"] Jun 09 12:06:22.241241 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:06:22.241217 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc03229_6e01_4766_956e_4a2b9611d6d5.slice/crio-369a9b0c6d5795d8e5899687d5b1bc61287239d73c0d7fc27954a1e387b40289 WatchSource:0}: Error finding container 369a9b0c6d5795d8e5899687d5b1bc61287239d73c0d7fc27954a1e387b40289: Status 404 returned error can't find the container with id 369a9b0c6d5795d8e5899687d5b1bc61287239d73c0d7fc27954a1e387b40289 Jun 09 12:06:22.280518 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.280483 2562 generic.go:356] "Generic (PLEG): container finished" podID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerID="ddf7674725e31b2a71cffeb28b8761de5ac25d418878ad3ec7ef6e4246cd0884" exitCode=0 Jun 09 12:06:22.280686 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.280585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" event={"ID":"66d76e3c-5923-4d05-9f0e-293e1cd6f822","Type":"ContainerDied","Data":"ddf7674725e31b2a71cffeb28b8761de5ac25d418878ad3ec7ef6e4246cd0884"} Jun 09 12:06:22.280750 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.280683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" event={"ID":"66d76e3c-5923-4d05-9f0e-293e1cd6f822","Type":"ContainerStarted","Data":"a244d778b362d9e4d412f5e543cd13fba8e3cf71be5759404f17cb73edb6a775"} Jun 09 12:06:22.283118 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.283090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" event={"ID":"9cc03229-6e01-4766-956e-4a2b9611d6d5","Type":"ContainerStarted","Data":"369a9b0c6d5795d8e5899687d5b1bc61287239d73c0d7fc27954a1e387b40289"} Jun 09 12:06:22.284800 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.284774 2562 generic.go:356] "Generic (PLEG): container finished" podID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerID="83df86abad23284e38ee7ebdb6167231774d836cd09ff7f07f3057055ab63899" exitCode=0 Jun 09 12:06:22.284952 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.284866 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" event={"ID":"821a3884-cdb8-4843-a766-6a44dfc4ccce","Type":"ContainerDied","Data":"83df86abad23284e38ee7ebdb6167231774d836cd09ff7f07f3057055ab63899"} Jun 09 12:06:22.284952 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.284916 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" event={"ID":"821a3884-cdb8-4843-a766-6a44dfc4ccce","Type":"ContainerStarted","Data":"3f7a5cd1015fdacda7b7434b20d70aa205e2cfafd282b4adb279ccdd48af13b9"} Jun 09 12:06:22.286683 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.286660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f7799b9c-hffrc" event={"ID":"f1d29dfb-0be5-4884-95af-ccd7497460b4","Type":"ContainerStarted","Data":"4b29c2e72d03f4b1d1eac8cd42b3dccc39dcd739dc47fca76cdef2002c25774c"} Jun 09 12:06:22.286790 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.286703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f7799b9c-hffrc" event={"ID":"f1d29dfb-0be5-4884-95af-ccd7497460b4","Type":"ContainerStarted","Data":"254ba44a3e047aff653f46677585197c445b75582a98425e27db0c610bc1df95"} Jun 09 12:06:22.331398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.331366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.331537 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.331407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.331537 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.331441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmwvp\" (UniqueName: \"kubernetes.io/projected/8d1157dc-fdf9-41d9-a375-f1affdd267aa-kube-api-access-qmwvp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.336379 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.336334 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56f7799b9c-hffrc" podStartSLOduration=1.336319802 podStartE2EDuration="1.336319802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:22.333948187 +0000 UTC m=+667.206211178" watchObservedRunningTime="2026-06-09 12:06:22.336319802 +0000 UTC m=+667.208582790" Jun 09 12:06:22.432224 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.432181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.432409 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.432241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.432409 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.432277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmwvp\" (UniqueName: \"kubernetes.io/projected/8d1157dc-fdf9-41d9-a375-f1affdd267aa-kube-api-access-qmwvp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.432765 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.432632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.432765 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.432645 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.441589 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.441551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmwvp\" (UniqueName: \"kubernetes.io/projected/8d1157dc-fdf9-41d9-a375-f1affdd267aa-kube-api-access-qmwvp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.500623 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.500582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:22.639409 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:22.639374 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq"] Jun 09 12:06:22.641790 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:06:22.641759 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1157dc_fdf9_41d9_a375_f1affdd267aa.slice/crio-ef124bcb8043ca502bacd0d8a3ba18514d6dac5aa97042fa0c5d81e534180697 WatchSource:0}: Error finding container ef124bcb8043ca502bacd0d8a3ba18514d6dac5aa97042fa0c5d81e534180697: Status 404 returned error can't find the container with id ef124bcb8043ca502bacd0d8a3ba18514d6dac5aa97042fa0c5d81e534180697 Jun 09 12:06:23.294020 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:23.293922 2562 generic.go:356] "Generic (PLEG): container finished" podID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerID="c45f78e4aed6897fe38477681beba729338f45c095ba05e91272ffe0b3d8fffd" exitCode=0 Jun 09 12:06:23.294437 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:23.294014 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" event={"ID":"66d76e3c-5923-4d05-9f0e-293e1cd6f822","Type":"ContainerDied","Data":"c45f78e4aed6897fe38477681beba729338f45c095ba05e91272ffe0b3d8fffd"} Jun 09 12:06:23.295621 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:23.295599 2562 generic.go:356] "Generic (PLEG): container finished" podID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerID="8fb6996cb3d9b766e13504a49e2fcede42402f97d61b7efd0dcdb51a77a311e6" exitCode=0 Jun 09 12:06:23.295728 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:23.295627 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" event={"ID":"9cc03229-6e01-4766-956e-4a2b9611d6d5","Type":"ContainerDied","Data":"8fb6996cb3d9b766e13504a49e2fcede42402f97d61b7efd0dcdb51a77a311e6"} Jun 09 12:06:23.297681 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:23.297662 2562 generic.go:356] "Generic (PLEG): container finished" podID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerID="13da736a3fda243cbd4a1bea98df5a9624a71120c88308a70248d87f136c4c9f" exitCode=0 Jun 09 12:06:23.297768 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:23.297727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" event={"ID":"821a3884-cdb8-4843-a766-6a44dfc4ccce","Type":"ContainerDied","Data":"13da736a3fda243cbd4a1bea98df5a9624a71120c88308a70248d87f136c4c9f"} Jun 09 12:06:23.299323 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:23.299299 2562 generic.go:356] "Generic (PLEG): container finished" podID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerID="14a850c1a492a8984f3d6045f3930790d0e677c125619e0afcb3501c6874cfa8" exitCode=0 Jun 09 12:06:23.299707 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:23.299474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" event={"ID":"8d1157dc-fdf9-41d9-a375-f1affdd267aa","Type":"ContainerDied","Data":"14a850c1a492a8984f3d6045f3930790d0e677c125619e0afcb3501c6874cfa8"} Jun 09 12:06:23.299707 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:23.299530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" event={"ID":"8d1157dc-fdf9-41d9-a375-f1affdd267aa","Type":"ContainerStarted","Data":"ef124bcb8043ca502bacd0d8a3ba18514d6dac5aa97042fa0c5d81e534180697"} Jun 09 12:06:24.307553 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:24.307512 2562 generic.go:356] "Generic (PLEG): container finished" podID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerID="ef41cf06c7d005a6220dddf078f89d2c599794316132d3ee7680efcfec4550ac" exitCode=0 Jun 09 12:06:24.307985 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:24.307552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" event={"ID":"66d76e3c-5923-4d05-9f0e-293e1cd6f822","Type":"ContainerDied","Data":"ef41cf06c7d005a6220dddf078f89d2c599794316132d3ee7680efcfec4550ac"} Jun 09 12:06:24.309541 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:24.309516 2562 generic.go:356] "Generic (PLEG): container finished" podID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerID="e634ea95cc75beeae4b779ef91460a8a7671ea29ea59cbdfabe45acece1e52dc" exitCode=0 Jun 09 12:06:24.309654 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:24.309587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" event={"ID":"9cc03229-6e01-4766-956e-4a2b9611d6d5","Type":"ContainerDied","Data":"e634ea95cc75beeae4b779ef91460a8a7671ea29ea59cbdfabe45acece1e52dc"} Jun 09 12:06:24.311789 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:24.311771 2562 generic.go:356] "Generic (PLEG): container finished" podID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerID="433767b99b90c9dca46b45b4f2a8791a3acaf5938120597c66c3dcae00a8d092" exitCode=0 Jun 09 12:06:24.311917 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:24.311849 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" event={"ID":"821a3884-cdb8-4843-a766-6a44dfc4ccce","Type":"ContainerDied","Data":"433767b99b90c9dca46b45b4f2a8791a3acaf5938120597c66c3dcae00a8d092"} Jun 09 12:06:24.313585 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:24.313566 2562 generic.go:356] "Generic (PLEG): container finished" podID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerID="326e522b083b333275201efd68b5e4b3b6fabafaf51836b0f64a77a18e8f5592" exitCode=0 Jun 09 12:06:24.313662 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:24.313612 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" event={"ID":"8d1157dc-fdf9-41d9-a375-f1affdd267aa","Type":"ContainerDied","Data":"326e522b083b333275201efd68b5e4b3b6fabafaf51836b0f64a77a18e8f5592"} Jun 09 12:06:25.321882 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.321847 2562 generic.go:356] "Generic (PLEG): container finished" podID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerID="1bc9afa1650b4c1c60c1462bae4d30ce36093f446454793d60bb78916f823b0d" exitCode=0 Jun 09 12:06:25.322291 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.321940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" event={"ID":"9cc03229-6e01-4766-956e-4a2b9611d6d5","Type":"ContainerDied","Data":"1bc9afa1650b4c1c60c1462bae4d30ce36093f446454793d60bb78916f823b0d"} Jun 09 12:06:25.323880 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.323854 2562 generic.go:356] "Generic (PLEG): container finished" podID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerID="ae129dab5136627228f9d101e08e4e650beb226e9bbf0aa53c1c0a35f2b87c0f" exitCode=0 Jun 09 12:06:25.324008 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.323945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" event={"ID":"8d1157dc-fdf9-41d9-a375-f1affdd267aa","Type":"ContainerDied","Data":"ae129dab5136627228f9d101e08e4e650beb226e9bbf0aa53c1c0a35f2b87c0f"} Jun 09 12:06:25.471092 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.471067 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:25.500789 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.500762 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:25.559790 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.559749 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzz26\" (UniqueName: \"kubernetes.io/projected/821a3884-cdb8-4843-a766-6a44dfc4ccce-kube-api-access-dzz26\") pod \"821a3884-cdb8-4843-a766-6a44dfc4ccce\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " Jun 09 12:06:25.559989 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.559846 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-util\") pod \"821a3884-cdb8-4843-a766-6a44dfc4ccce\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " Jun 09 12:06:25.559989 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.559928 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-bundle\") pod \"821a3884-cdb8-4843-a766-6a44dfc4ccce\" (UID: \"821a3884-cdb8-4843-a766-6a44dfc4ccce\") " Jun 09 12:06:25.560389 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.560362 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-bundle" (OuterVolumeSpecName: "bundle") pod "821a3884-cdb8-4843-a766-6a44dfc4ccce" (UID: "821a3884-cdb8-4843-a766-6a44dfc4ccce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:25.562165 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.562136 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/821a3884-cdb8-4843-a766-6a44dfc4ccce-kube-api-access-dzz26" (OuterVolumeSpecName: "kube-api-access-dzz26") pod "821a3884-cdb8-4843-a766-6a44dfc4ccce" (UID: "821a3884-cdb8-4843-a766-6a44dfc4ccce"). InnerVolumeSpecName "kube-api-access-dzz26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:25.567681 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.567636 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-util" (OuterVolumeSpecName: "util") pod "821a3884-cdb8-4843-a766-6a44dfc4ccce" (UID: "821a3884-cdb8-4843-a766-6a44dfc4ccce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:25.660988 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.660950 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trzks\" (UniqueName: \"kubernetes.io/projected/66d76e3c-5923-4d05-9f0e-293e1cd6f822-kube-api-access-trzks\") pod \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " Jun 09 12:06:25.661124 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.661011 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-bundle\") pod \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " Jun 09 12:06:25.661124 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.661090 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-util\") pod \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\" (UID: \"66d76e3c-5923-4d05-9f0e-293e1cd6f822\") " Jun 09 12:06:25.661744 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.661479 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:25.661744 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.661506 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzz26\" (UniqueName: \"kubernetes.io/projected/821a3884-cdb8-4843-a766-6a44dfc4ccce-kube-api-access-dzz26\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:25.661744 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.661522 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821a3884-cdb8-4843-a766-6a44dfc4ccce-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:25.661744 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.661581 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-bundle" (OuterVolumeSpecName: "bundle") pod "66d76e3c-5923-4d05-9f0e-293e1cd6f822" (UID: "66d76e3c-5923-4d05-9f0e-293e1cd6f822"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:25.663663 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.663642 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d76e3c-5923-4d05-9f0e-293e1cd6f822-kube-api-access-trzks" (OuterVolumeSpecName: "kube-api-access-trzks") pod "66d76e3c-5923-4d05-9f0e-293e1cd6f822" (UID: "66d76e3c-5923-4d05-9f0e-293e1cd6f822"). InnerVolumeSpecName "kube-api-access-trzks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:25.667200 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.667179 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-util" (OuterVolumeSpecName: "util") pod "66d76e3c-5923-4d05-9f0e-293e1cd6f822" (UID: "66d76e3c-5923-4d05-9f0e-293e1cd6f822"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:25.762504 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.762469 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:25.762504 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.762501 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trzks\" (UniqueName: \"kubernetes.io/projected/66d76e3c-5923-4d05-9f0e-293e1cd6f822-kube-api-access-trzks\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:25.762504 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:25.762512 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66d76e3c-5923-4d05-9f0e-293e1cd6f822-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:26.331865 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.331837 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" Jun 09 12:06:26.331865 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.331849 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd" event={"ID":"66d76e3c-5923-4d05-9f0e-293e1cd6f822","Type":"ContainerDied","Data":"a244d778b362d9e4d412f5e543cd13fba8e3cf71be5759404f17cb73edb6a775"} Jun 09 12:06:26.332317 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.331909 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a244d778b362d9e4d412f5e543cd13fba8e3cf71be5759404f17cb73edb6a775" Jun 09 12:06:26.333838 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.333800 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" Jun 09 12:06:26.333968 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.333844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9" event={"ID":"821a3884-cdb8-4843-a766-6a44dfc4ccce","Type":"ContainerDied","Data":"3f7a5cd1015fdacda7b7434b20d70aa205e2cfafd282b4adb279ccdd48af13b9"} Jun 09 12:06:26.333968 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.333885 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f7a5cd1015fdacda7b7434b20d70aa205e2cfafd282b4adb279ccdd48af13b9" Jun 09 12:06:26.501951 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.501927 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:26.502942 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.502924 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:26.673170 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.673136 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-util\") pod \"9cc03229-6e01-4766-956e-4a2b9611d6d5\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " Jun 09 12:06:26.673366 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.673201 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-bundle\") pod \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " Jun 09 12:06:26.673366 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.673227 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-util\") pod \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " Jun 09 12:06:26.673366 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.673276 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4r7w\" (UniqueName: \"kubernetes.io/projected/9cc03229-6e01-4766-956e-4a2b9611d6d5-kube-api-access-m4r7w\") pod \"9cc03229-6e01-4766-956e-4a2b9611d6d5\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " Jun 09 12:06:26.673366 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.673357 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmwvp\" (UniqueName: \"kubernetes.io/projected/8d1157dc-fdf9-41d9-a375-f1affdd267aa-kube-api-access-qmwvp\") pod \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\" (UID: \"8d1157dc-fdf9-41d9-a375-f1affdd267aa\") " Jun 09 12:06:26.673577 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.673388 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-bundle\") pod \"9cc03229-6e01-4766-956e-4a2b9611d6d5\" (UID: \"9cc03229-6e01-4766-956e-4a2b9611d6d5\") " Jun 09 12:06:26.673973 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.673938 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-bundle" (OuterVolumeSpecName: "bundle") pod "9cc03229-6e01-4766-956e-4a2b9611d6d5" (UID: "9cc03229-6e01-4766-956e-4a2b9611d6d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:26.674103 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.674000 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-bundle" (OuterVolumeSpecName: "bundle") pod "8d1157dc-fdf9-41d9-a375-f1affdd267aa" (UID: "8d1157dc-fdf9-41d9-a375-f1affdd267aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:26.675596 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.675575 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc03229-6e01-4766-956e-4a2b9611d6d5-kube-api-access-m4r7w" (OuterVolumeSpecName: "kube-api-access-m4r7w") pod "9cc03229-6e01-4766-956e-4a2b9611d6d5" (UID: "9cc03229-6e01-4766-956e-4a2b9611d6d5"). InnerVolumeSpecName "kube-api-access-m4r7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:26.675695 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.675602 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d1157dc-fdf9-41d9-a375-f1affdd267aa-kube-api-access-qmwvp" (OuterVolumeSpecName: "kube-api-access-qmwvp") pod "8d1157dc-fdf9-41d9-a375-f1affdd267aa" (UID: "8d1157dc-fdf9-41d9-a375-f1affdd267aa"). InnerVolumeSpecName "kube-api-access-qmwvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:26.678993 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.678972 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-util" (OuterVolumeSpecName: "util") pod "8d1157dc-fdf9-41d9-a375-f1affdd267aa" (UID: "8d1157dc-fdf9-41d9-a375-f1affdd267aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:26.681238 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.681214 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-util" (OuterVolumeSpecName: "util") pod "9cc03229-6e01-4766-956e-4a2b9611d6d5" (UID: "9cc03229-6e01-4766-956e-4a2b9611d6d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:26.774233 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.774179 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4r7w\" (UniqueName: \"kubernetes.io/projected/9cc03229-6e01-4766-956e-4a2b9611d6d5-kube-api-access-m4r7w\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:26.774233 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.774227 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmwvp\" (UniqueName: \"kubernetes.io/projected/8d1157dc-fdf9-41d9-a375-f1affdd267aa-kube-api-access-qmwvp\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:26.774233 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.774239 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:26.774233 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.774247 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc03229-6e01-4766-956e-4a2b9611d6d5-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:26.774233 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.774255 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:26.774550 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:26.774262 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d1157dc-fdf9-41d9-a375-f1affdd267aa-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:27.341431 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:27.341399 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" Jun 09 12:06:27.341877 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:27.341399 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r" event={"ID":"9cc03229-6e01-4766-956e-4a2b9611d6d5","Type":"ContainerDied","Data":"369a9b0c6d5795d8e5899687d5b1bc61287239d73c0d7fc27954a1e387b40289"} Jun 09 12:06:27.341877 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:27.341533 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="369a9b0c6d5795d8e5899687d5b1bc61287239d73c0d7fc27954a1e387b40289" Jun 09 12:06:27.343425 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:27.343401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" event={"ID":"8d1157dc-fdf9-41d9-a375-f1affdd267aa","Type":"ContainerDied","Data":"ef124bcb8043ca502bacd0d8a3ba18514d6dac5aa97042fa0c5d81e534180697"} Jun 09 12:06:27.343425 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:27.343428 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq" Jun 09 12:06:27.343571 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:27.343441 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef124bcb8043ca502bacd0d8a3ba18514d6dac5aa97042fa0c5d81e534180697" Jun 09 12:06:31.464458 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:31.464405 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:31.465084 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:31.464510 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:31.469866 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:31.469836 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:32.376632 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:32.376604 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56f7799b9c-hffrc" Jun 09 12:06:32.474562 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:32.474532 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc6f678b7-bd5w4"] Jun 09 12:06:42.382538 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382501 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm"] Jun 09 12:06:42.382932 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382909 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerName="util" Jun 09 12:06:42.382932 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382922 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerName="util" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382935 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerName="util" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382941 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerName="util" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382948 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerName="pull" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382954 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerName="pull" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382960 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerName="extract" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382965 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerName="extract" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382974 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerName="util" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382980 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerName="util" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382986 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerName="util" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382991 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerName="util" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.382997 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerName="pull" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383001 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerName="pull" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383008 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerName="extract" Jun 09 12:06:42.383010 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383014 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerName="extract" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383022 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerName="extract" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383027 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerName="extract" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383042 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerName="pull" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383047 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerName="pull" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383053 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerName="pull" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383058 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerName="pull" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383064 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerName="extract" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383069 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerName="extract" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383128 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc03229-6e01-4766-956e-4a2b9611d6d5" containerName="extract" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383137 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d1157dc-fdf9-41d9-a375-f1affdd267aa" containerName="extract" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383145 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="821a3884-cdb8-4843-a766-6a44dfc4ccce" containerName="extract" Jun 09 12:06:42.383407 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.383151 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="66d76e3c-5923-4d05-9f0e-293e1cd6f822" containerName="extract" Jun 09 12:06:42.386344 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.386327 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:06:42.388919 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.388894 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:06:42.389879 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.389860 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:06:42.389993 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.389877 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rjz8f\"" Jun 09 12:06:42.405189 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.405122 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm"] Jun 09 12:06:42.423335 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.423297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz8kr\" (UniqueName: \"kubernetes.io/projected/6924bfd3-d532-44fc-99eb-6d5bbe26b4dd-kube-api-access-gz8kr\") pod \"limitador-operator-controller-manager-859d7b78bd-drjmm\" (UID: \"6924bfd3-d532-44fc-99eb-6d5bbe26b4dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:06:42.524492 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.524462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz8kr\" (UniqueName: \"kubernetes.io/projected/6924bfd3-d532-44fc-99eb-6d5bbe26b4dd-kube-api-access-gz8kr\") pod \"limitador-operator-controller-manager-859d7b78bd-drjmm\" (UID: \"6924bfd3-d532-44fc-99eb-6d5bbe26b4dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:06:42.538660 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.538626 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz8kr\" (UniqueName: \"kubernetes.io/projected/6924bfd3-d532-44fc-99eb-6d5bbe26b4dd-kube-api-access-gz8kr\") pod \"limitador-operator-controller-manager-859d7b78bd-drjmm\" (UID: \"6924bfd3-d532-44fc-99eb-6d5bbe26b4dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:06:42.697212 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.697174 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:06:42.850209 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:42.850096 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm"] Jun 09 12:06:42.852868 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:06:42.852838 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6924bfd3_d532_44fc_99eb_6d5bbe26b4dd.slice/crio-33df951667a151d0a960b6cae0a883f51972b685c95256165f8999c3c0aaec24 WatchSource:0}: Error finding container 33df951667a151d0a960b6cae0a883f51972b685c95256165f8999c3c0aaec24: Status 404 returned error can't find the container with id 33df951667a151d0a960b6cae0a883f51972b685c95256165f8999c3c0aaec24 Jun 09 12:06:43.442687 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:43.442647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" event={"ID":"6924bfd3-d532-44fc-99eb-6d5bbe26b4dd","Type":"ContainerStarted","Data":"33df951667a151d0a960b6cae0a883f51972b685c95256165f8999c3c0aaec24"} Jun 09 12:06:46.463197 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:46.463154 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" event={"ID":"6924bfd3-d532-44fc-99eb-6d5bbe26b4dd","Type":"ContainerStarted","Data":"97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0"} Jun 09 12:06:46.463699 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:46.463258 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:06:46.491784 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:46.491719 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" podStartSLOduration=1.8203422790000001 podStartE2EDuration="4.491702363s" totalImagesPullingTime="2.671360084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:46.488958578 +0000 UTC m=+691.361221565" watchObservedRunningTime="2026-06-09 12:06:46.491702363 +0000 UTC m=+691.363965350" Jun 09 12:06:57.471443 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.471413 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:06:57.495605 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.495557 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7dc6f678b7-bd5w4" podUID="2272e824-1039-4ace-aeca-a945204e8780" containerName="console" containerID="cri-o://b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285" gracePeriod=15 Jun 09 12:06:57.765401 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.765372 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:06:57.880658 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.880628 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-oauth-serving-cert\") pod \"2272e824-1039-4ace-aeca-a945204e8780\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " Jun 09 12:06:57.880865 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.880698 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-oauth-config\") pod \"2272e824-1039-4ace-aeca-a945204e8780\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " Jun 09 12:06:57.880865 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.880727 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-service-ca\") pod \"2272e824-1039-4ace-aeca-a945204e8780\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " Jun 09 12:06:57.880865 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.880753 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-trusted-ca-bundle\") pod \"2272e824-1039-4ace-aeca-a945204e8780\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " Jun 09 12:06:57.880865 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.880786 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-console-config\") pod \"2272e824-1039-4ace-aeca-a945204e8780\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " Jun 09 12:06:57.880865 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.880848 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-serving-cert\") pod \"2272e824-1039-4ace-aeca-a945204e8780\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " Jun 09 12:06:57.881116 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.880916 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbgg4\" (UniqueName: \"kubernetes.io/projected/2272e824-1039-4ace-aeca-a945204e8780-kube-api-access-zbgg4\") pod \"2272e824-1039-4ace-aeca-a945204e8780\" (UID: \"2272e824-1039-4ace-aeca-a945204e8780\") " Jun 09 12:06:57.881275 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.881216 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2272e824-1039-4ace-aeca-a945204e8780" (UID: "2272e824-1039-4ace-aeca-a945204e8780"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:06:57.881742 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.881693 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-service-ca" (OuterVolumeSpecName: "service-ca") pod "2272e824-1039-4ace-aeca-a945204e8780" (UID: "2272e824-1039-4ace-aeca-a945204e8780"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:06:57.881920 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.881790 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-console-config" (OuterVolumeSpecName: "console-config") pod "2272e824-1039-4ace-aeca-a945204e8780" (UID: "2272e824-1039-4ace-aeca-a945204e8780"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:06:57.882154 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.882112 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2272e824-1039-4ace-aeca-a945204e8780" (UID: "2272e824-1039-4ace-aeca-a945204e8780"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:06:57.886859 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.884036 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2272e824-1039-4ace-aeca-a945204e8780" (UID: "2272e824-1039-4ace-aeca-a945204e8780"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:06:57.886859 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.884046 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2272e824-1039-4ace-aeca-a945204e8780" (UID: "2272e824-1039-4ace-aeca-a945204e8780"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:06:57.886859 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.884299 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2272e824-1039-4ace-aeca-a945204e8780-kube-api-access-zbgg4" (OuterVolumeSpecName: "kube-api-access-zbgg4") pod "2272e824-1039-4ace-aeca-a945204e8780" (UID: "2272e824-1039-4ace-aeca-a945204e8780"). InnerVolumeSpecName "kube-api-access-zbgg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:57.982613 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.982577 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-service-ca\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:57.982613 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.982610 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-trusted-ca-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:57.982613 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.982621 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-console-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:57.982887 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.982630 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:57.982887 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.982639 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbgg4\" (UniqueName: \"kubernetes.io/projected/2272e824-1039-4ace-aeca-a945204e8780-kube-api-access-zbgg4\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:57.982887 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.982648 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2272e824-1039-4ace-aeca-a945204e8780-oauth-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:57.982887 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:57.982656 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2272e824-1039-4ace-aeca-a945204e8780-console-oauth-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:06:58.535329 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:58.535292 2562 generic.go:356] "Generic (PLEG): container finished" podID="2272e824-1039-4ace-aeca-a945204e8780" containerID="b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285" exitCode=0 Jun 09 12:06:58.535772 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:58.535351 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc6f678b7-bd5w4" event={"ID":"2272e824-1039-4ace-aeca-a945204e8780","Type":"ContainerDied","Data":"b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285"} Jun 09 12:06:58.535772 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:58.535358 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc6f678b7-bd5w4" Jun 09 12:06:58.535772 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:58.535430 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc6f678b7-bd5w4" event={"ID":"2272e824-1039-4ace-aeca-a945204e8780","Type":"ContainerDied","Data":"a23192688e21e96f386a032213b1ac476e0335b0ac03aacd90619586dd61a68d"} Jun 09 12:06:58.535772 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:58.535459 2562 scope.go:117] "RemoveContainer" containerID="b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285" Jun 09 12:06:58.545035 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:58.545007 2562 scope.go:117] "RemoveContainer" containerID="b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285" Jun 09 12:06:58.545300 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:06:58.545277 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285\": container with ID starting with b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285 not found: ID does not exist" containerID="b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285" Jun 09 12:06:58.545347 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:58.545308 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285"} err="failed to get container status \"b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285\": rpc error: code = NotFound desc = could not find container \"b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285\": container with ID starting with b077df1f53154752b29bf49cbfb920eb7311c16a41a71ef0f3cc6aab7e8e4285 not found: ID does not exist" Jun 09 12:06:58.558480 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:58.558447 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc6f678b7-bd5w4"] Jun 09 12:06:58.564620 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:58.564596 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc6f678b7-bd5w4"] Jun 09 12:06:59.569198 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:06:59.569159 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2272e824-1039-4ace-aeca-a945204e8780" path="/var/lib/kubelet/pods/2272e824-1039-4ace-aeca-a945204e8780/volumes" Jun 09 12:07:01.750292 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.750212 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm"] Jun 09 12:07:01.750675 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.750416 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" containerName="manager" containerID="cri-o://97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0" gracePeriod=2 Jun 09 12:07:01.774494 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.774455 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm"] Jun 09 12:07:01.782929 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:07:01.782882 2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6924bfd3-d532-44fc-99eb-6d5bbe26b4dd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-drjmm\": pods \"limitador-operator-controller-manager-859d7b78bd-drjmm\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:07:01.812868 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.812837 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm"] Jun 09 12:07:01.813241 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.813229 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2272e824-1039-4ace-aeca-a945204e8780" containerName="console" Jun 09 12:07:01.813293 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.813242 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2272e824-1039-4ace-aeca-a945204e8780" containerName="console" Jun 09 12:07:01.813293 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.813255 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" containerName="manager" Jun 09 12:07:01.813293 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.813261 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" containerName="manager" Jun 09 12:07:01.813403 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.813329 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" containerName="manager" Jun 09 12:07:01.813403 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.813339 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2272e824-1039-4ace-aeca-a945204e8780" containerName="console" Jun 09 12:07:01.817154 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.817123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" Jun 09 12:07:01.819502 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:07:01.819466 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wzhdm\" is forbidden: User \"system:node:ip-10-0-141-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-91.ec2.internal' and this object" podUID="d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" Jun 09 12:07:01.822092 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:07:01.822064 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-drjmm\" is forbidden: User \"system:node:ip-10-0-141-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-91.ec2.internal' and this object" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:07:01.838850 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.838803 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm"] Jun 09 12:07:01.920716 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.920685 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dx92\" (UniqueName: \"kubernetes.io/projected/d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18-kube-api-access-9dx92\") pod \"limitador-operator-controller-manager-859d7b78bd-wzhdm\" (UID: \"d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" Jun 09 12:07:01.995883 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:01.995789 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:07:02.021305 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.021215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dx92\" (UniqueName: \"kubernetes.io/projected/d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18-kube-api-access-9dx92\") pod \"limitador-operator-controller-manager-859d7b78bd-wzhdm\" (UID: \"d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" Jun 09 12:07:02.043261 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.043223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dx92\" (UniqueName: \"kubernetes.io/projected/d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18-kube-api-access-9dx92\") pod \"limitador-operator-controller-manager-859d7b78bd-wzhdm\" (UID: \"d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" Jun 09 12:07:02.043551 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:07:02.043296 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-drjmm\" is forbidden: User \"system:node:ip-10-0-141-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-91.ec2.internal' and this object" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:07:02.122380 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.122333 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz8kr\" (UniqueName: \"kubernetes.io/projected/6924bfd3-d532-44fc-99eb-6d5bbe26b4dd-kube-api-access-gz8kr\") pod \"6924bfd3-d532-44fc-99eb-6d5bbe26b4dd\" (UID: \"6924bfd3-d532-44fc-99eb-6d5bbe26b4dd\") " Jun 09 12:07:02.124417 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.124393 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6924bfd3-d532-44fc-99eb-6d5bbe26b4dd-kube-api-access-gz8kr" (OuterVolumeSpecName: "kube-api-access-gz8kr") pod "6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" (UID: "6924bfd3-d532-44fc-99eb-6d5bbe26b4dd"). InnerVolumeSpecName "kube-api-access-gz8kr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:07:02.127560 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.127538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" Jun 09 12:07:02.224035 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.224003 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz8kr\" (UniqueName: \"kubernetes.io/projected/6924bfd3-d532-44fc-99eb-6d5bbe26b4dd-kube-api-access-gz8kr\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:07:02.318549 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.318516 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm"] Jun 09 12:07:02.320148 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:07:02.320119 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d1f529_64c7_4723_bb0a_3f9a5f3f6f18.slice/crio-c2708d357d9561fce32209f9cc2fc835e5d7d455f760619603a7e3fc7d2a64c5 WatchSource:0}: Error finding container c2708d357d9561fce32209f9cc2fc835e5d7d455f760619603a7e3fc7d2a64c5: Status 404 returned error can't find the container with id c2708d357d9561fce32209f9cc2fc835e5d7d455f760619603a7e3fc7d2a64c5 Jun 09 12:07:02.560497 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.560461 2562 generic.go:356] "Generic (PLEG): container finished" podID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" containerID="97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0" exitCode=0 Jun 09 12:07:02.560696 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.560513 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:07:02.560696 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.560525 2562 scope.go:117] "RemoveContainer" containerID="97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0" Jun 09 12:07:02.562510 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.562483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" event={"ID":"d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18","Type":"ContainerStarted","Data":"668a6f5ec470f5bb1563dbece4ae969d3da70593406955820612e6ce57cc3e3c"} Jun 09 12:07:02.562625 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.562527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" event={"ID":"d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18","Type":"ContainerStarted","Data":"c2708d357d9561fce32209f9cc2fc835e5d7d455f760619603a7e3fc7d2a64c5"} Jun 09 12:07:02.562625 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.562551 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" Jun 09 12:07:02.567157 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:07:02.567097 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-drjmm\" is forbidden: User \"system:node:ip-10-0-141-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-91.ec2.internal' and this object" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:07:02.571320 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.571300 2562 scope.go:117] "RemoveContainer" containerID="97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0" Jun 09 12:07:02.571591 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:07:02.571574 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0\": container with ID starting with 97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0 not found: ID does not exist" containerID="97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0" Jun 09 12:07:02.571658 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.571596 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0"} err="failed to get container status \"97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0\": rpc error: code = NotFound desc = could not find container \"97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0\": container with ID starting with 97ad77dc92241e3d9138682a3e8b8fb218b0afbeb766e3b7ce2a77066d4360c0 not found: ID does not exist" Jun 09 12:07:02.618564 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:02.618509 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" podStartSLOduration=1.618487845 podStartE2EDuration="1.618487845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:02.617738916 +0000 UTC m=+707.490001905" watchObservedRunningTime="2026-06-09 12:07:02.618487845 +0000 UTC m=+707.490750832" Jun 09 12:07:02.623286 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:07:02.623255 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-drjmm\" is forbidden: User \"system:node:ip-10-0-141-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-91.ec2.internal' and this object" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:07:02.625357 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:07:02.625328 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-drjmm\" is forbidden: User \"system:node:ip-10-0-141-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-91.ec2.internal' and this object" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drjmm" Jun 09 12:07:03.569054 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:03.569016 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6924bfd3-d532-44fc-99eb-6d5bbe26b4dd" path="/var/lib/kubelet/pods/6924bfd3-d532-44fc-99eb-6d5bbe26b4dd/volumes" Jun 09 12:07:13.571353 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:13.571320 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzhdm" Jun 09 12:07:48.426892 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.426860 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqjt"] Jun 09 12:07:48.430386 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.430368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:07:48.437012 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.436974 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vkqf9\"" Jun 09 12:07:48.437553 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.437418 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 12:07:48.449466 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.449431 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqjt"] Jun 09 12:07:48.529871 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.529837 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqjt"] Jun 09 12:07:48.546616 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.546575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzq6w\" (UniqueName: \"kubernetes.io/projected/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-kube-api-access-lzq6w\") pod \"limitador-limitador-64c94fd64f-prqjt\" (UID: \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:07:48.546790 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.546657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-config-file\") pod \"limitador-limitador-64c94fd64f-prqjt\" (UID: \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:07:48.650254 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.647465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzq6w\" (UniqueName: \"kubernetes.io/projected/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-kube-api-access-lzq6w\") pod \"limitador-limitador-64c94fd64f-prqjt\" (UID: \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:07:48.650254 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.647558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-config-file\") pod \"limitador-limitador-64c94fd64f-prqjt\" (UID: \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:07:48.650254 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.648317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-config-file\") pod \"limitador-limitador-64c94fd64f-prqjt\" (UID: \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:07:48.661980 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.661944 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzq6w\" (UniqueName: \"kubernetes.io/projected/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-kube-api-access-lzq6w\") pod \"limitador-limitador-64c94fd64f-prqjt\" (UID: \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:07:48.741383 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.741276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:07:48.890926 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:48.890881 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqjt"] Jun 09 12:07:48.892472 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:07:48.892438 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7dbbe9b_88f4_4a9e_bc69_701f14f4807c.slice/crio-03974e4a9db52b82d182363b39d012af02ca9d19ef4d525d054a39f18aacfdd5 WatchSource:0}: Error finding container 03974e4a9db52b82d182363b39d012af02ca9d19ef4d525d054a39f18aacfdd5: Status 404 returned error can't find the container with id 03974e4a9db52b82d182363b39d012af02ca9d19ef4d525d054a39f18aacfdd5 Jun 09 12:07:49.838923 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:49.838878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" event={"ID":"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c","Type":"ContainerStarted","Data":"03974e4a9db52b82d182363b39d012af02ca9d19ef4d525d054a39f18aacfdd5"} Jun 09 12:07:51.852450 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:51.852407 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" event={"ID":"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c","Type":"ContainerStarted","Data":"8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159"} Jun 09 12:07:51.852868 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:51.852503 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:07:51.872411 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:07:51.872356 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" podStartSLOduration=1.107078376 podStartE2EDuration="3.872338859s" totalImagesPullingTime="2.765260483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:51.870039045 +0000 UTC m=+756.742302034" watchObservedRunningTime="2026-06-09 12:07:51.872338859 +0000 UTC m=+756.744601892" Jun 09 12:08:02.860875 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:02.860808 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:08:03.152870 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.152730 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqjt"] Jun 09 12:08:03.153058 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.152972 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" podUID="b7dbbe9b-88f4-4a9e-bc69-701f14f4807c" containerName="limitador" containerID="cri-o://8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159" gracePeriod=30 Jun 09 12:08:03.703625 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.703600 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:08:03.792579 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.792490 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzq6w\" (UniqueName: \"kubernetes.io/projected/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-kube-api-access-lzq6w\") pod \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\" (UID: \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\") " Jun 09 12:08:03.792579 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.792555 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-config-file\") pod \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\" (UID: \"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c\") " Jun 09 12:08:03.792953 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.792922 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-config-file" (OuterVolumeSpecName: "config-file") pod "b7dbbe9b-88f4-4a9e-bc69-701f14f4807c" (UID: "b7dbbe9b-88f4-4a9e-bc69-701f14f4807c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:08:03.794678 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.794645 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-kube-api-access-lzq6w" (OuterVolumeSpecName: "kube-api-access-lzq6w") pod "b7dbbe9b-88f4-4a9e-bc69-701f14f4807c" (UID: "b7dbbe9b-88f4-4a9e-bc69-701f14f4807c"). InnerVolumeSpecName "kube-api-access-lzq6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:08:03.894039 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.894007 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzq6w\" (UniqueName: \"kubernetes.io/projected/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-kube-api-access-lzq6w\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:08:03.894039 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.894034 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c-config-file\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:08:03.922135 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.922100 2562 generic.go:356] "Generic (PLEG): container finished" podID="b7dbbe9b-88f4-4a9e-bc69-701f14f4807c" containerID="8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159" exitCode=0 Jun 09 12:08:03.922288 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.922145 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" Jun 09 12:08:03.922288 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.922179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" event={"ID":"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c","Type":"ContainerDied","Data":"8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159"} Jun 09 12:08:03.922288 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.922224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqjt" event={"ID":"b7dbbe9b-88f4-4a9e-bc69-701f14f4807c","Type":"ContainerDied","Data":"03974e4a9db52b82d182363b39d012af02ca9d19ef4d525d054a39f18aacfdd5"} Jun 09 12:08:03.922288 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.922249 2562 scope.go:117] "RemoveContainer" containerID="8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159" Jun 09 12:08:03.931623 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.931599 2562 scope.go:117] "RemoveContainer" containerID="8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159" Jun 09 12:08:03.931890 ip-10-0-141-91 kubenswrapper[2562]: E0609 12:08:03.931872 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159\": container with ID starting with 8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159 not found: ID does not exist" containerID="8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159" Jun 09 12:08:03.931963 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.931901 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159"} err="failed to get container status \"8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159\": rpc error: code = NotFound desc = could not find container \"8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159\": container with ID starting with 8a1db3e4f42a4b671dd358cdd6cd3b948158e3b2ffaac302c4046c4b06548159 not found: ID does not exist" Jun 09 12:08:03.943961 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.943938 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqjt"] Jun 09 12:08:03.949846 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:03.949808 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqjt"] Jun 09 12:08:04.472022 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.471983 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-d499c"] Jun 09 12:08:04.472491 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.472471 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7dbbe9b-88f4-4a9e-bc69-701f14f4807c" containerName="limitador" Jun 09 12:08:04.472584 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.472495 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7dbbe9b-88f4-4a9e-bc69-701f14f4807c" containerName="limitador" Jun 09 12:08:04.472642 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.472630 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7dbbe9b-88f4-4a9e-bc69-701f14f4807c" containerName="limitador" Jun 09 12:08:04.477206 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.477180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:04.479369 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.479345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 12:08:04.483563 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.483536 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-d499c"] Jun 09 12:08:04.499144 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.499109 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/71a93fcf-5fcc-4168-a8d4-cf2706be5151-data\") pod \"postgres-69fb4594cf-d499c\" (UID: \"71a93fcf-5fcc-4168-a8d4-cf2706be5151\") " pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:04.499343 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.499166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5cmv\" (UniqueName: \"kubernetes.io/projected/71a93fcf-5fcc-4168-a8d4-cf2706be5151-kube-api-access-c5cmv\") pod \"postgres-69fb4594cf-d499c\" (UID: \"71a93fcf-5fcc-4168-a8d4-cf2706be5151\") " pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:04.600077 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.600046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/71a93fcf-5fcc-4168-a8d4-cf2706be5151-data\") pod \"postgres-69fb4594cf-d499c\" (UID: \"71a93fcf-5fcc-4168-a8d4-cf2706be5151\") " pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:04.600251 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.600221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5cmv\" (UniqueName: \"kubernetes.io/projected/71a93fcf-5fcc-4168-a8d4-cf2706be5151-kube-api-access-c5cmv\") pod \"postgres-69fb4594cf-d499c\" (UID: \"71a93fcf-5fcc-4168-a8d4-cf2706be5151\") " pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:04.600447 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.600425 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/71a93fcf-5fcc-4168-a8d4-cf2706be5151-data\") pod \"postgres-69fb4594cf-d499c\" (UID: \"71a93fcf-5fcc-4168-a8d4-cf2706be5151\") " pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:04.608931 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.608897 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5cmv\" (UniqueName: \"kubernetes.io/projected/71a93fcf-5fcc-4168-a8d4-cf2706be5151-kube-api-access-c5cmv\") pod \"postgres-69fb4594cf-d499c\" (UID: \"71a93fcf-5fcc-4168-a8d4-cf2706be5151\") " pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:04.790540 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.790437 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:04.927492 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:04.927469 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-d499c"] Jun 09 12:08:04.928961 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:08:04.928933 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a93fcf_5fcc_4168_a8d4_cf2706be5151.slice/crio-f9b9313a464c29fea559c586d8d52c98b45e5d1008b4b71f59267972c6bbd304 WatchSource:0}: Error finding container f9b9313a464c29fea559c586d8d52c98b45e5d1008b4b71f59267972c6bbd304: Status 404 returned error can't find the container with id f9b9313a464c29fea559c586d8d52c98b45e5d1008b4b71f59267972c6bbd304 Jun 09 12:08:05.572035 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:05.571993 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7dbbe9b-88f4-4a9e-bc69-701f14f4807c" path="/var/lib/kubelet/pods/b7dbbe9b-88f4-4a9e-bc69-701f14f4807c/volumes" Jun 09 12:08:05.940113 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:05.940069 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-d499c" event={"ID":"71a93fcf-5fcc-4168-a8d4-cf2706be5151","Type":"ContainerStarted","Data":"f9b9313a464c29fea559c586d8d52c98b45e5d1008b4b71f59267972c6bbd304"} Jun 09 12:08:07.952992 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:07.952955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-d499c" event={"ID":"71a93fcf-5fcc-4168-a8d4-cf2706be5151","Type":"ContainerStarted","Data":"d5fb60eb855e6a064a468c08d8e114b17fe4611a5e74bc8603233f199f12ac59"} Jun 09 12:08:07.953383 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:07.953018 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:07.973273 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:07.973223 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-d499c" podStartSLOduration=1.883909008 podStartE2EDuration="3.973207181s" totalImagesPullingTime="2.089298173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:08:07.97057425 +0000 UTC m=+772.842837259" watchObservedRunningTime="2026-06-09 12:08:07.973207181 +0000 UTC m=+772.845470169" Jun 09 12:08:13.993097 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:13.993068 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-d499c" Jun 09 12:08:15.672899 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.672865 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx"] Jun 09 12:08:15.681733 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.681712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.684657 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.684629 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:08:15.685074 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.685051 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:08:15.685658 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.685634 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gbmwp\"" Jun 09 12:08:15.688915 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.688895 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx"] Jun 09 12:08:15.804289 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.804253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.804487 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.804325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk7ms\" (UniqueName: \"kubernetes.io/projected/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-kube-api-access-tk7ms\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.804487 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.804374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.905747 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.905667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.905747 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.905728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.905945 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.905765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7ms\" (UniqueName: \"kubernetes.io/projected/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-kube-api-access-tk7ms\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.906100 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.906081 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.906144 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.906099 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.917873 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.917850 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk7ms\" (UniqueName: \"kubernetes.io/projected/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-kube-api-access-tk7ms\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:15.992754 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:15.992720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:16.140264 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:16.140239 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx"] Jun 09 12:08:17.007178 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:17.007141 2562 generic.go:356] "Generic (PLEG): container finished" podID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerID="5fdf603023b9f8d6012cc53c6b63428826012e9ca1d2bca776f00e9e1f87ba8f" exitCode=0 Jun 09 12:08:17.007552 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:17.007220 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" event={"ID":"d50c5b88-8bd5-49c5-96fe-c60fe29706dc","Type":"ContainerDied","Data":"5fdf603023b9f8d6012cc53c6b63428826012e9ca1d2bca776f00e9e1f87ba8f"} Jun 09 12:08:17.007552 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:17.007268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" event={"ID":"d50c5b88-8bd5-49c5-96fe-c60fe29706dc","Type":"ContainerStarted","Data":"d711b92c76d453aac038af6301f978d3bbdb07050c6986fcfdb548d0f92ff698"} Jun 09 12:08:18.014191 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:18.014150 2562 generic.go:356] "Generic (PLEG): container finished" podID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerID="bd9a5e4c8047944347d8b977d74282c819c2db30230325df682f7191bdbdfef4" exitCode=0 Jun 09 12:08:18.014577 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:18.014233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" event={"ID":"d50c5b88-8bd5-49c5-96fe-c60fe29706dc","Type":"ContainerDied","Data":"bd9a5e4c8047944347d8b977d74282c819c2db30230325df682f7191bdbdfef4"} Jun 09 12:08:19.021998 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:19.021962 2562 generic.go:356] "Generic (PLEG): container finished" podID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerID="fb172fcb490288ff1fcf4743715a51ade11ead7d4354f2ed173efdb869157789" exitCode=0 Jun 09 12:08:19.022385 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:19.022037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" event={"ID":"d50c5b88-8bd5-49c5-96fe-c60fe29706dc","Type":"ContainerDied","Data":"fb172fcb490288ff1fcf4743715a51ade11ead7d4354f2ed173efdb869157789"} Jun 09 12:08:20.168757 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.168729 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:20.247893 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.247856 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-util\") pod \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " Jun 09 12:08:20.248078 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.247951 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-bundle\") pod \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " Jun 09 12:08:20.248078 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.248021 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk7ms\" (UniqueName: \"kubernetes.io/projected/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-kube-api-access-tk7ms\") pod \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\" (UID: \"d50c5b88-8bd5-49c5-96fe-c60fe29706dc\") " Jun 09 12:08:20.248412 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.248383 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-bundle" (OuterVolumeSpecName: "bundle") pod "d50c5b88-8bd5-49c5-96fe-c60fe29706dc" (UID: "d50c5b88-8bd5-49c5-96fe-c60fe29706dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:08:20.250109 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.250077 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-kube-api-access-tk7ms" (OuterVolumeSpecName: "kube-api-access-tk7ms") pod "d50c5b88-8bd5-49c5-96fe-c60fe29706dc" (UID: "d50c5b88-8bd5-49c5-96fe-c60fe29706dc"). InnerVolumeSpecName "kube-api-access-tk7ms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:08:20.253364 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.253333 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-util" (OuterVolumeSpecName: "util") pod "d50c5b88-8bd5-49c5-96fe-c60fe29706dc" (UID: "d50c5b88-8bd5-49c5-96fe-c60fe29706dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:08:20.349705 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.349628 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk7ms\" (UniqueName: \"kubernetes.io/projected/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-kube-api-access-tk7ms\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:08:20.349705 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.349655 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:08:20.349705 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:20.349664 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d50c5b88-8bd5-49c5-96fe-c60fe29706dc-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:08:21.035559 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:21.035520 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" event={"ID":"d50c5b88-8bd5-49c5-96fe-c60fe29706dc","Type":"ContainerDied","Data":"d711b92c76d453aac038af6301f978d3bbdb07050c6986fcfdb548d0f92ff698"} Jun 09 12:08:21.035724 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:21.035565 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748xp6vx" Jun 09 12:08:21.035724 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:21.035578 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d711b92c76d453aac038af6301f978d3bbdb07050c6986fcfdb548d0f92ff698" Jun 09 12:08:23.742264 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.742222 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-vw4cs"] Jun 09 12:08:23.742796 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.742766 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerName="pull" Jun 09 12:08:23.742796 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.742790 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerName="pull" Jun 09 12:08:23.742962 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.742846 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerName="util" Jun 09 12:08:23.742962 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.742856 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerName="util" Jun 09 12:08:23.742962 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.742870 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerName="extract" Jun 09 12:08:23.742962 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.742876 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerName="extract" Jun 09 12:08:23.742962 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.742949 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d50c5b88-8bd5-49c5-96fe-c60fe29706dc" containerName="extract" Jun 09 12:08:23.745224 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.745208 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-vw4cs" Jun 09 12:08:23.748487 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.748463 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 12:08:23.749196 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.749173 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-z7rjg\"" Jun 09 12:08:23.749196 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.749174 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 12:08:23.762857 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.762828 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-vw4cs"] Jun 09 12:08:23.886546 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.886506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpprz\" (UniqueName: \"kubernetes.io/projected/10c99033-8f05-41ec-b37b-8d98b6205dc6-kube-api-access-mpprz\") pod \"keycloak-operator-d67dbbb48-vw4cs\" (UID: \"10c99033-8f05-41ec-b37b-8d98b6205dc6\") " pod="keycloak-system/keycloak-operator-d67dbbb48-vw4cs" Jun 09 12:08:23.987719 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.987682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpprz\" (UniqueName: \"kubernetes.io/projected/10c99033-8f05-41ec-b37b-8d98b6205dc6-kube-api-access-mpprz\") pod \"keycloak-operator-d67dbbb48-vw4cs\" (UID: \"10c99033-8f05-41ec-b37b-8d98b6205dc6\") " pod="keycloak-system/keycloak-operator-d67dbbb48-vw4cs" Jun 09 12:08:23.996976 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:23.996905 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpprz\" (UniqueName: \"kubernetes.io/projected/10c99033-8f05-41ec-b37b-8d98b6205dc6-kube-api-access-mpprz\") pod \"keycloak-operator-d67dbbb48-vw4cs\" (UID: \"10c99033-8f05-41ec-b37b-8d98b6205dc6\") " pod="keycloak-system/keycloak-operator-d67dbbb48-vw4cs" Jun 09 12:08:24.056095 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:24.056061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-vw4cs" Jun 09 12:08:24.198668 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:24.198640 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-vw4cs"] Jun 09 12:08:24.200064 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:08:24.200036 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c99033_8f05_41ec_b37b_8d98b6205dc6.slice/crio-daa1b406065f6a25729d9f000e4c2c90ebdd601a933d25c18ae08fc4f32d694d WatchSource:0}: Error finding container daa1b406065f6a25729d9f000e4c2c90ebdd601a933d25c18ae08fc4f32d694d: Status 404 returned error can't find the container with id daa1b406065f6a25729d9f000e4c2c90ebdd601a933d25c18ae08fc4f32d694d Jun 09 12:08:25.063237 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:25.063191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-vw4cs" event={"ID":"10c99033-8f05-41ec-b37b-8d98b6205dc6","Type":"ContainerStarted","Data":"daa1b406065f6a25729d9f000e4c2c90ebdd601a933d25c18ae08fc4f32d694d"} Jun 09 12:08:31.104721 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:31.104666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-vw4cs" event={"ID":"10c99033-8f05-41ec-b37b-8d98b6205dc6","Type":"ContainerStarted","Data":"5d750825b8c75771bcd260a0ede87249dd6a972dc9b0f909abf00c4a8cb3e57e"} Jun 09 12:08:31.123066 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:08:31.123003 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-vw4cs" podStartSLOduration=1.699371288 podStartE2EDuration="8.122984741s" totalImagesPullingTime="6.423613453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:08:31.121163446 +0000 UTC m=+795.993426436" watchObservedRunningTime="2026-06-09 12:08:31.122984741 +0000 UTC m=+795.995247729" Jun 09 12:10:15.729990 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:10:15.729959 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:10:15.730705 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:10:15.730688 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:11:19.992866 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:19.992805 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv"] Jun 09 12:11:19.996428 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:19.996405 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:19.999937 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:19.999914 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 12:11:19.999937 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:19.999930 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 12:11:20.000160 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:19.999950 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 12:11:20.000160 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:19.999919 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7lhz9\"" Jun 09 12:11:20.007071 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.007046 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv"] Jun 09 12:11:20.153285 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.153247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67c2fbdb-ff83-488c-a67a-3daeb9adb324-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.153285 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.153287 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.153525 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.153314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh2v7\" (UniqueName: \"kubernetes.io/projected/67c2fbdb-ff83-488c-a67a-3daeb9adb324-kube-api-access-sh2v7\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.153525 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.153409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.153525 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.153448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.153525 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.153477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.254796 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.254687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67c2fbdb-ff83-488c-a67a-3daeb9adb324-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.254796 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.254736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.254796 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.254767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh2v7\" (UniqueName: \"kubernetes.io/projected/67c2fbdb-ff83-488c-a67a-3daeb9adb324-kube-api-access-sh2v7\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.255145 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.254839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.255145 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.254882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.255145 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.254919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.255375 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.255295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.255375 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.255348 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.255472 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.255398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.257114 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.257095 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67c2fbdb-ff83-488c-a67a-3daeb9adb324-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.257398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.257379 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67c2fbdb-ff83-488c-a67a-3daeb9adb324-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.263250 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.263226 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh2v7\" (UniqueName: \"kubernetes.io/projected/67c2fbdb-ff83-488c-a67a-3daeb9adb324-kube-api-access-sh2v7\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv\" (UID: \"67c2fbdb-ff83-488c-a67a-3daeb9adb324\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.308218 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.308180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:11:20.449839 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.449793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv"] Jun 09 12:11:20.451402 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:11:20.451374 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c2fbdb_ff83_488c_a67a_3daeb9adb324.slice/crio-a8eef3b33f442ca51cce87c3f3895466d91a6b770d7c149f9203d2527af2d1e5 WatchSource:0}: Error finding container a8eef3b33f442ca51cce87c3f3895466d91a6b770d7c149f9203d2527af2d1e5: Status 404 returned error can't find the container with id a8eef3b33f442ca51cce87c3f3895466d91a6b770d7c149f9203d2527af2d1e5 Jun 09 12:11:20.453306 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:20.453288 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:11:21.138312 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:21.138270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" event={"ID":"67c2fbdb-ff83-488c-a67a-3daeb9adb324","Type":"ContainerStarted","Data":"a8eef3b33f442ca51cce87c3f3895466d91a6b770d7c149f9203d2527af2d1e5"} Jun 09 12:11:24.162620 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:11:24.162580 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" event={"ID":"67c2fbdb-ff83-488c-a67a-3daeb9adb324","Type":"ContainerStarted","Data":"402d73c61577569dbc7e27835b5749cbc259afc4645bfb1ac9d9a2f82c74e88e"} Jun 09 12:12:17.473713 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:12:17.473676 2562 generic.go:356] "Generic (PLEG): container finished" podID="67c2fbdb-ff83-488c-a67a-3daeb9adb324" containerID="402d73c61577569dbc7e27835b5749cbc259afc4645bfb1ac9d9a2f82c74e88e" exitCode=0 Jun 09 12:12:17.474146 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:12:17.473748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" event={"ID":"67c2fbdb-ff83-488c-a67a-3daeb9adb324","Type":"ContainerDied","Data":"402d73c61577569dbc7e27835b5749cbc259afc4645bfb1ac9d9a2f82c74e88e"} Jun 09 12:12:19.488244 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:12:19.488201 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" event={"ID":"67c2fbdb-ff83-488c-a67a-3daeb9adb324","Type":"ContainerStarted","Data":"4b7b5a8262a80e025f32e7029f16327dbac8f636091ee4943f661de4cc91f51a"} Jun 09 12:12:19.510631 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:12:19.510577 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" podStartSLOduration=3.105184913 podStartE2EDuration="1m0.510559981s" totalImagesPullingTime="4.30185146s" totalInitContainerRuntime="53.103523608s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:11:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:12:19.507508144 +0000 UTC m=+1024.379771134" watchObservedRunningTime="2026-06-09 12:12:19.510559981 +0000 UTC m=+1024.382822969" Jun 09 12:12:20.308780 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:12:20.308740 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:12:20.309005 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:12:20.308810 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:12:20.321565 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:12:20.321535 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:12:20.505984 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:12:20.505952 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv" Jun 09 12:15:00.146714 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:00.146681 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29683455-lkkxg"] Jun 09 12:15:00.150227 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:00.150211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" Jun 09 12:15:00.153398 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:00.153360 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xkvhg\"" Jun 09 12:15:00.159414 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:00.159388 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683455-lkkxg"] Jun 09 12:15:00.243630 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:00.243597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ql2j\" (UniqueName: \"kubernetes.io/projected/039c3213-e5a0-415a-8df1-d9ce21042fd8-kube-api-access-4ql2j\") pod \"maas-api-key-cleanup-29683455-lkkxg\" (UID: \"039c3213-e5a0-415a-8df1-d9ce21042fd8\") " pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" Jun 09 12:15:00.344999 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:00.344967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ql2j\" (UniqueName: \"kubernetes.io/projected/039c3213-e5a0-415a-8df1-d9ce21042fd8-kube-api-access-4ql2j\") pod \"maas-api-key-cleanup-29683455-lkkxg\" (UID: \"039c3213-e5a0-415a-8df1-d9ce21042fd8\") " pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" Jun 09 12:15:00.353793 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:00.353761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ql2j\" (UniqueName: \"kubernetes.io/projected/039c3213-e5a0-415a-8df1-d9ce21042fd8-kube-api-access-4ql2j\") pod \"maas-api-key-cleanup-29683455-lkkxg\" (UID: \"039c3213-e5a0-415a-8df1-d9ce21042fd8\") " pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" Jun 09 12:15:00.462507 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:00.462479 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" Jun 09 12:15:00.598427 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:00.598400 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683455-lkkxg"] Jun 09 12:15:00.600155 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:15:00.600129 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039c3213_e5a0_415a_8df1_d9ce21042fd8.slice/crio-eb61cb5f558c634c14b7a1a170483b61f25be57c42f5b909b1e71e45554f9943 WatchSource:0}: Error finding container eb61cb5f558c634c14b7a1a170483b61f25be57c42f5b909b1e71e45554f9943: Status 404 returned error can't find the container with id eb61cb5f558c634c14b7a1a170483b61f25be57c42f5b909b1e71e45554f9943 Jun 09 12:15:01.455827 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:01.455785 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" event={"ID":"039c3213-e5a0-415a-8df1-d9ce21042fd8","Type":"ContainerStarted","Data":"eb61cb5f558c634c14b7a1a170483b61f25be57c42f5b909b1e71e45554f9943"} Jun 09 12:15:03.471373 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:03.471333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" event={"ID":"039c3213-e5a0-415a-8df1-d9ce21042fd8","Type":"ContainerStarted","Data":"72f8b4e6166cc2a116039e6f22956189e59aa3f2f3d133222ddaa6047f96b5cf"} Jun 09 12:15:03.490102 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:03.490054 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" podStartSLOduration=1.369763342 podStartE2EDuration="3.490039042s" totalImagesPullingTime="2.1202757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:15:03.488036608 +0000 UTC m=+1188.360299590" watchObservedRunningTime="2026-06-09 12:15:03.490039042 +0000 UTC m=+1188.362302030" Jun 09 12:15:04.478689 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:04.478648 2562 generic.go:356] "Generic (PLEG): container finished" podID="039c3213-e5a0-415a-8df1-d9ce21042fd8" containerID="72f8b4e6166cc2a116039e6f22956189e59aa3f2f3d133222ddaa6047f96b5cf" exitCode=0 Jun 09 12:15:04.479112 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:04.478704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" event={"ID":"039c3213-e5a0-415a-8df1-d9ce21042fd8","Type":"ContainerDied","Data":"72f8b4e6166cc2a116039e6f22956189e59aa3f2f3d133222ddaa6047f96b5cf"} Jun 09 12:15:05.624702 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:05.624678 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" Jun 09 12:15:05.693735 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:05.693699 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ql2j\" (UniqueName: \"kubernetes.io/projected/039c3213-e5a0-415a-8df1-d9ce21042fd8-kube-api-access-4ql2j\") pod \"039c3213-e5a0-415a-8df1-d9ce21042fd8\" (UID: \"039c3213-e5a0-415a-8df1-d9ce21042fd8\") " Jun 09 12:15:05.695958 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:05.695923 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/039c3213-e5a0-415a-8df1-d9ce21042fd8-kube-api-access-4ql2j" (OuterVolumeSpecName: "kube-api-access-4ql2j") pod "039c3213-e5a0-415a-8df1-d9ce21042fd8" (UID: "039c3213-e5a0-415a-8df1-d9ce21042fd8"). InnerVolumeSpecName "kube-api-access-4ql2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:15:05.795301 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:05.795214 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ql2j\" (UniqueName: \"kubernetes.io/projected/039c3213-e5a0-415a-8df1-d9ce21042fd8-kube-api-access-4ql2j\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jun 09 12:15:06.491593 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:06.491565 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" Jun 09 12:15:06.491774 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:06.491602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683455-lkkxg" event={"ID":"039c3213-e5a0-415a-8df1-d9ce21042fd8","Type":"ContainerDied","Data":"eb61cb5f558c634c14b7a1a170483b61f25be57c42f5b909b1e71e45554f9943"} Jun 09 12:15:06.491774 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:06.491645 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb61cb5f558c634c14b7a1a170483b61f25be57c42f5b909b1e71e45554f9943" Jun 09 12:15:15.770704 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:15.770675 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:15:15.774270 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:15:15.774245 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:20:15.811600 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:20:15.811573 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:20:15.816078 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:20:15.816055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:21:35.102915 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:35.102886 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76df79655d-gxwx5_d42c0fe7-f49b-40a1-94ba-dbc2f566efe4/nginx/0.log" Jun 09 12:21:35.219669 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:35.219644 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-fwmxk_1285b0b5-215d-4cf4-ae7f-6eb419e84dbc/manager/0.log" Jun 09 12:21:35.341862 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:35.341836 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5hpz7_1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22/manager/0.log" Jun 09 12:21:35.580112 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:35.580088 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683455-lkkxg_039c3213-e5a0-415a-8df1-d9ce21042fd8/cleanup/0.log" Jun 09 12:21:35.797991 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:35.797965 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-7sbkl_3e9772f9-c89f-4d0b-8a4b-76db506014ad/server/0.log" Jun 09 12:21:35.914430 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:35.914401 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ngr7w_9ae8c206-b699-464a-8c38-415d074fe591/manager/0.log" Jun 09 12:21:36.027363 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:36.027332 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86976b546f-66bm8_85eda9fa-3354-48d9-bdf5-b32e6765e958/manager/0.log" Jun 09 12:21:36.033972 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:36.033950 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86976b546f-66bm8_85eda9fa-3354-48d9-bdf5-b32e6765e958/copy-manifests/0.log" Jun 09 12:21:36.415237 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:36.415215 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-d499c_71a93fcf-5fcc-4168-a8d4-cf2706be5151/postgres/0.log" Jun 09 12:21:37.189339 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.189314 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r_9cc03229-6e01-4766-956e-4a2b9611d6d5/util/0.log" Jun 09 12:21:37.197403 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.197383 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r_9cc03229-6e01-4766-956e-4a2b9611d6d5/pull/0.log" Jun 09 12:21:37.204113 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.204094 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r_9cc03229-6e01-4766-956e-4a2b9611d6d5/extract/0.log" Jun 09 12:21:37.316678 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.316655 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9_821a3884-cdb8-4843-a766-6a44dfc4ccce/util/0.log" Jun 09 12:21:37.326720 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.326702 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9_821a3884-cdb8-4843-a766-6a44dfc4ccce/pull/0.log" Jun 09 12:21:37.335305 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.335285 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9_821a3884-cdb8-4843-a766-6a44dfc4ccce/extract/0.log" Jun 09 12:21:37.449989 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.449915 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq_8d1157dc-fdf9-41d9-a375-f1affdd267aa/util/0.log" Jun 09 12:21:37.457312 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.457288 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq_8d1157dc-fdf9-41d9-a375-f1affdd267aa/pull/0.log" Jun 09 12:21:37.464069 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.464050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq_8d1157dc-fdf9-41d9-a375-f1affdd267aa/extract/0.log" Jun 09 12:21:37.574134 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.574107 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd_66d76e3c-5923-4d05-9f0e-293e1cd6f822/util/0.log" Jun 09 12:21:37.580833 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.580797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd_66d76e3c-5923-4d05-9f0e-293e1cd6f822/pull/0.log" Jun 09 12:21:37.587448 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:37.587432 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd_66d76e3c-5923-4d05-9f0e-293e1cd6f822/extract/0.log" Jun 09 12:21:38.504371 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:38.504342 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wzhdm_d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18/manager/0.log" Jun 09 12:21:38.977285 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:38.977256 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f6h64_5f27d741-7ee4-40f6-9990-6d93b721a9be/discovery/0.log" Jun 09 12:21:39.211178 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:39.211151 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd697648d-lpvwp_61acf8bc-bb39-4c2d-a3ee-a69958079c1f/kube-auth-proxy/0.log" Jun 09 12:21:39.693256 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:39.693227 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b557d5689-j6d6t_b44287d9-a75c-4f23-8f8e-afd6f07dd79e/router/0.log" Jun 09 12:21:40.271697 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:40.271666 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv_67c2fbdb-ff83-488c-a67a-3daeb9adb324/storage-initializer/0.log" Jun 09 12:21:40.279711 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:40.279689 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4t8gv_67c2fbdb-ff83-488c-a67a-3daeb9adb324/main/0.log" Jun 09 12:21:44.449191 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.449159 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bn8ls/must-gather-l82tt"] Jun 09 12:21:44.449621 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.449607 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="039c3213-e5a0-415a-8df1-d9ce21042fd8" containerName="cleanup" Jun 09 12:21:44.449666 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.449623 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="039c3213-e5a0-415a-8df1-d9ce21042fd8" containerName="cleanup" Jun 09 12:21:44.449722 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.449712 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="039c3213-e5a0-415a-8df1-d9ce21042fd8" containerName="cleanup" Jun 09 12:21:44.452020 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.452003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bn8ls/must-gather-l82tt" Jun 09 12:21:44.455135 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.455112 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bn8ls\"/\"kube-root-ca.crt\"" Jun 09 12:21:44.455255 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.455202 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bn8ls\"/\"openshift-service-ca.crt\"" Jun 09 12:21:44.455255 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.455225 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bn8ls\"/\"default-dockercfg-pl9tb\"" Jun 09 12:21:44.463577 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.463554 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bn8ls/must-gather-l82tt"] Jun 09 12:21:44.577413 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.577381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/861e5c8f-0b17-4f75-bdac-c552b5e4cd7f-must-gather-output\") pod \"must-gather-l82tt\" (UID: \"861e5c8f-0b17-4f75-bdac-c552b5e4cd7f\") " pod="openshift-must-gather-bn8ls/must-gather-l82tt" Jun 09 12:21:44.577557 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.577450 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4n79\" (UniqueName: \"kubernetes.io/projected/861e5c8f-0b17-4f75-bdac-c552b5e4cd7f-kube-api-access-b4n79\") pod \"must-gather-l82tt\" (UID: \"861e5c8f-0b17-4f75-bdac-c552b5e4cd7f\") " pod="openshift-must-gather-bn8ls/must-gather-l82tt" Jun 09 12:21:44.678136 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.678107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/861e5c8f-0b17-4f75-bdac-c552b5e4cd7f-must-gather-output\") pod \"must-gather-l82tt\" (UID: \"861e5c8f-0b17-4f75-bdac-c552b5e4cd7f\") " pod="openshift-must-gather-bn8ls/must-gather-l82tt" Jun 09 12:21:44.678326 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.678171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4n79\" (UniqueName: \"kubernetes.io/projected/861e5c8f-0b17-4f75-bdac-c552b5e4cd7f-kube-api-access-b4n79\") pod \"must-gather-l82tt\" (UID: \"861e5c8f-0b17-4f75-bdac-c552b5e4cd7f\") " pod="openshift-must-gather-bn8ls/must-gather-l82tt" Jun 09 12:21:44.678488 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.678462 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/861e5c8f-0b17-4f75-bdac-c552b5e4cd7f-must-gather-output\") pod \"must-gather-l82tt\" (UID: \"861e5c8f-0b17-4f75-bdac-c552b5e4cd7f\") " pod="openshift-must-gather-bn8ls/must-gather-l82tt" Jun 09 12:21:44.687222 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.687195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4n79\" (UniqueName: \"kubernetes.io/projected/861e5c8f-0b17-4f75-bdac-c552b5e4cd7f-kube-api-access-b4n79\") pod \"must-gather-l82tt\" (UID: \"861e5c8f-0b17-4f75-bdac-c552b5e4cd7f\") " pod="openshift-must-gather-bn8ls/must-gather-l82tt" Jun 09 12:21:44.763315 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.763247 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bn8ls/must-gather-l82tt" Jun 09 12:21:44.904639 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.904611 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bn8ls/must-gather-l82tt"] Jun 09 12:21:44.905347 ip-10-0-141-91 kubenswrapper[2562]: W0609 12:21:44.905314 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod861e5c8f_0b17_4f75_bdac_c552b5e4cd7f.slice/crio-52ff1d95cbe57d9952ba0e5c624dc009f9625923ac629415abcc3ffb9c0f21bb WatchSource:0}: Error finding container 52ff1d95cbe57d9952ba0e5c624dc009f9625923ac629415abcc3ffb9c0f21bb: Status 404 returned error can't find the container with id 52ff1d95cbe57d9952ba0e5c624dc009f9625923ac629415abcc3ffb9c0f21bb Jun 09 12:21:44.907127 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:44.907112 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:21:45.895362 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:45.895327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bn8ls/must-gather-l82tt" event={"ID":"861e5c8f-0b17-4f75-bdac-c552b5e4cd7f","Type":"ContainerStarted","Data":"52ff1d95cbe57d9952ba0e5c624dc009f9625923ac629415abcc3ffb9c0f21bb"} Jun 09 12:21:46.904444 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:46.904406 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bn8ls/must-gather-l82tt" event={"ID":"861e5c8f-0b17-4f75-bdac-c552b5e4cd7f","Type":"ContainerStarted","Data":"16c58e46a241aa08f79911ac7a08044315ded7ea3aae4bafce6d66d34cd69ea0"} Jun 09 12:21:46.904837 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:46.904456 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bn8ls/must-gather-l82tt" event={"ID":"861e5c8f-0b17-4f75-bdac-c552b5e4cd7f","Type":"ContainerStarted","Data":"965e774c59ca469cbb45324534c4391b1fcf60a4fad2f90945b875c8352ca748"} Jun 09 12:21:46.921921 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:46.921855 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bn8ls/must-gather-l82tt" podStartSLOduration=1.745397583 podStartE2EDuration="2.921835801s" totalImagesPullingTime="1.176438218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:21:46.921370077 +0000 UTC m=+1591.793633077" watchObservedRunningTime="2026-06-09 12:21:46.921835801 +0000 UTC m=+1591.794098787" Jun 09 12:21:47.878134 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:47.878088 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rgt2r_377b75bb-6ace-4ed4-93fd-0489635ff132/global-pull-secret-syncer/0.log" Jun 09 12:21:47.960338 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:47.960305 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mflnv_9a6f2c58-ed1b-420a-93b0-37296567aab5/konnectivity-agent/0.log" Jun 09 12:21:48.085579 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:48.085534 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-91.ec2.internal_5da38127d24e86e0bfd6d18050999520/haproxy/0.log" Jun 09 12:21:51.954095 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:51.954059 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-pqzf7_e4644e28-b07d-4e5e-a2b8-bdc7cc70b024/sail-operator/0.log" Jun 09 12:21:52.616331 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.616238 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r_9cc03229-6e01-4766-956e-4a2b9611d6d5/extract/0.log" Jun 09 12:21:52.638846 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.638787 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r_9cc03229-6e01-4766-956e-4a2b9611d6d5/util/0.log" Jun 09 12:21:52.666680 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.666643 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594f49r_9cc03229-6e01-4766-956e-4a2b9611d6d5/pull/0.log" Jun 09 12:21:52.700302 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.700252 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9_821a3884-cdb8-4843-a766-6a44dfc4ccce/extract/0.log" Jun 09 12:21:52.754842 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.750600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9_821a3884-cdb8-4843-a766-6a44dfc4ccce/util/0.log" Jun 09 12:21:52.792928 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.792865 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qwkj9_821a3884-cdb8-4843-a766-6a44dfc4ccce/pull/0.log" Jun 09 12:21:52.830349 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.830319 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq_8d1157dc-fdf9-41d9-a375-f1affdd267aa/extract/0.log" Jun 09 12:21:52.866928 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.866843 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq_8d1157dc-fdf9-41d9-a375-f1affdd267aa/util/0.log" Jun 09 12:21:52.892016 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.891987 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mmlq_8d1157dc-fdf9-41d9-a375-f1affdd267aa/pull/0.log" Jun 09 12:21:52.923269 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.923238 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd_66d76e3c-5923-4d05-9f0e-293e1cd6f822/extract/0.log" Jun 09 12:21:52.949797 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.949768 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd_66d76e3c-5923-4d05-9f0e-293e1cd6f822/util/0.log" Jun 09 12:21:52.975926 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:52.975882 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7tjd_66d76e3c-5923-4d05-9f0e-293e1cd6f822/pull/0.log" Jun 09 12:21:53.359493 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:53.359461 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wzhdm_d9d1f529-64c7-4723-bb0a-3f9a5f3f6f18/manager/0.log" Jun 09 12:21:55.573599 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:55.573134 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-844fd5f967-tx792_eb111204-25a3-43dd-afcd-24de9b132d0f/metrics-server/0.log" Jun 09 12:21:55.653064 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:55.652884 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-v5lrk_25bc5e14-b906-44eb-bb4e-ac2835f9df4d/monitoring-plugin/0.log" Jun 09 12:21:55.848219 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:55.848169 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wzqpk_d726bf68-e882-4836-8b7b-295c79838dc7/node-exporter/0.log" Jun 09 12:21:55.894231 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:55.894205 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wzqpk_d726bf68-e882-4836-8b7b-295c79838dc7/kube-rbac-proxy/0.log" Jun 09 12:21:55.939474 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:55.939448 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wzqpk_d726bf68-e882-4836-8b7b-295c79838dc7/init-textfile/0.log" Jun 09 12:21:56.807411 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:56.807377 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-j6cm7_3bf13fd1-b972-4fd3-8e08-e469469cce93/prometheus-operator-admission-webhook/0.log" Jun 09 12:21:56.868792 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:56.868762 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dcd889c4-c2hbm_7856819d-5ed9-424d-ad66-a34e4d3ebe2e/telemeter-client/0.log" Jun 09 12:21:56.908446 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:56.908420 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dcd889c4-c2hbm_7856819d-5ed9-424d-ad66-a34e4d3ebe2e/reload/0.log" Jun 09 12:21:56.958479 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:56.958449 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dcd889c4-c2hbm_7856819d-5ed9-424d-ad66-a34e4d3ebe2e/kube-rbac-proxy/0.log" Jun 09 12:21:57.008621 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:57.008591 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f65758cd-j9t2n_29c35eb4-861e-4468-9ae5-a08d9741464e/thanos-query/0.log" Jun 09 12:21:57.061069 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:57.060992 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f65758cd-j9t2n_29c35eb4-861e-4468-9ae5-a08d9741464e/kube-rbac-proxy-web/0.log" Jun 09 12:21:57.097667 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:57.097638 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f65758cd-j9t2n_29c35eb4-861e-4468-9ae5-a08d9741464e/kube-rbac-proxy/0.log" Jun 09 12:21:57.131490 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:57.131455 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f65758cd-j9t2n_29c35eb4-861e-4468-9ae5-a08d9741464e/prom-label-proxy/0.log" Jun 09 12:21:57.162597 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:57.162565 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f65758cd-j9t2n_29c35eb4-861e-4468-9ae5-a08d9741464e/kube-rbac-proxy-rules/0.log" Jun 09 12:21:57.192560 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:57.192528 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f65758cd-j9t2n_29c35eb4-861e-4468-9ae5-a08d9741464e/kube-rbac-proxy-metrics/0.log" Jun 09 12:21:58.326417 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.326389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-kqbnh_9e8db230-c3dc-47e2-b74d-e2aab2770133/networking-console-plugin/0.log" Jun 09 12:21:58.563273 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.563242 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd"] Jun 09 12:21:58.578622 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.578533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.582506 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.582474 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd"] Jun 09 12:21:58.736476 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.736441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-lib-modules\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.736476 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.736478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq9c5\" (UniqueName: \"kubernetes.io/projected/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-kube-api-access-xq9c5\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.736681 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.736514 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-sys\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.736729 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.736675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-podres\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.736770 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.736739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-proc\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.837900 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.837787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-sys\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.838223 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.838201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-podres\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.838538 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.838522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-proc\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.838777 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.838760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-lib-modules\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.839044 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.839028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq9c5\" (UniqueName: \"kubernetes.io/projected/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-kube-api-access-xq9c5\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.839533 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.838689 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-proc\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.839666 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.838447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-podres\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.839778 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.838987 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-lib-modules\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.839908 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.838049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-sys\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.848805 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.848772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq9c5\" (UniqueName: \"kubernetes.io/projected/0d25d726-aeb0-49c4-9e8e-4d67f8e235d3-kube-api-access-xq9c5\") pod \"perf-node-gather-daemonset-dh8gd\" (UID: \"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:58.894537 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:58.894503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:21:59.053983 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:59.053948 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/2.log" Jun 09 12:21:59.059343 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:59.059306 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rmgp_baa81a0d-4a24-42f3-a8b3-06bdaaa795df/console-operator/3.log" Jun 09 12:21:59.098047 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:59.097956 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd"] Jun 09 12:21:59.592722 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:59.592695 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56f7799b9c-hffrc_f1d29dfb-0be5-4884-95af-ccd7497460b4/console/0.log" Jun 09 12:21:59.625655 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:21:59.625627 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-n4rdw_85b81937-25fe-4a9d-ad8f-84371ce15b6d/download-server/0.log" Jun 09 12:22:00.035147 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:00.035103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" event={"ID":"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3","Type":"ContainerStarted","Data":"56e6a688a234df6a61cf5a54b10ff2400282ceeb88460b1029d2b6d68a7b6869"} Jun 09 12:22:00.035347 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:00.035184 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" event={"ID":"0d25d726-aeb0-49c4-9e8e-4d67f8e235d3","Type":"ContainerStarted","Data":"89369bef169f3fd3944262c2036cb367e783bca965c02719cff60c219fa40899"} Jun 09 12:22:00.035486 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:00.035466 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:22:00.055520 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:00.055473 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" podStartSLOduration=2.055458069 podStartE2EDuration="2.055458069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:22:00.053995987 +0000 UTC m=+1604.926258976" watchObservedRunningTime="2026-06-09 12:22:00.055458069 +0000 UTC m=+1604.927721059" Jun 09 12:22:00.247459 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:00.247428 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-zjjn4_671ccb9a-9d87-4187-88e6-d0862c5c181c/volume-data-source-validator/0.log" Jun 09 12:22:01.344681 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:01.344608 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-glnpb_7a9fb9ea-d453-4b7a-9987-07911094c803/dns/0.log" Jun 09 12:22:01.367470 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:01.367434 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-glnpb_7a9fb9ea-d453-4b7a-9987-07911094c803/kube-rbac-proxy/0.log" Jun 09 12:22:01.539302 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:01.539266 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pb7fh_363c33d6-6510-4dc4-b6a4-b4c3b600bdb9/dns-node-resolver/0.log" Jun 09 12:22:02.147343 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:02.147316 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-84c6dfb985-66pc2_61e47b6d-f4a8-43fc-b747-e018c80286d1/registry/0.log" Jun 09 12:22:02.173746 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:02.173711 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fd8t9_1d1e36e7-7f10-4b1b-970f-2253327f8836/node-ca/0.log" Jun 09 12:22:03.251773 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:03.251717 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f6h64_5f27d741-7ee4-40f6-9990-6d93b721a9be/discovery/0.log" Jun 09 12:22:03.307126 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:03.307100 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd697648d-lpvwp_61acf8bc-bb39-4c2d-a3ee-a69958079c1f/kube-auth-proxy/0.log" Jun 09 12:22:03.457485 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:03.457453 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b557d5689-j6d6t_b44287d9-a75c-4f23-8f8e-afd6f07dd79e/router/0.log" Jun 09 12:22:04.148723 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:04.148695 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nsdkd_da4eee00-a2f1-448e-a6a4-b58e50974f4d/serve-healthcheck-canary/0.log" Jun 09 12:22:04.677410 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:04.677360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-j4x8s_3210dd5c-7a75-4748-8e92-e03a30b00980/insights-operator/0.log" Jun 09 12:22:04.678801 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:04.678781 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-j4x8s_3210dd5c-7a75-4748-8e92-e03a30b00980/insights-operator/1.log" Jun 09 12:22:04.776347 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:04.776320 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b2n79_9e064597-2eef-4676-9a3e-ff5e6966c41b/kube-rbac-proxy/0.log" Jun 09 12:22:04.797893 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:04.797865 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b2n79_9e064597-2eef-4676-9a3e-ff5e6966c41b/exporter/0.log" Jun 09 12:22:04.820643 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:04.820619 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b2n79_9e064597-2eef-4676-9a3e-ff5e6966c41b/extractor/0.log" Jun 09 12:22:06.053627 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:06.053601 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-dh8gd" Jun 09 12:22:07.497189 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:07.497164 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76df79655d-gxwx5_d42c0fe7-f49b-40a1-94ba-dbc2f566efe4/nginx/0.log" Jun 09 12:22:07.525111 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:07.525084 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-fwmxk_1285b0b5-215d-4cf4-ae7f-6eb419e84dbc/manager/0.log" Jun 09 12:22:07.593633 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:07.592241 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5hpz7_1dcc3b2b-5d0f-4776-bef7-e2cb8527ff22/manager/0.log" Jun 09 12:22:07.644435 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:07.644406 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683455-lkkxg_039c3213-e5a0-415a-8df1-d9ce21042fd8/cleanup/0.log" Jun 09 12:22:07.722406 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:07.722375 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-7sbkl_3e9772f9-c89f-4d0b-8a4b-76db506014ad/server/0.log" Jun 09 12:22:07.782936 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:07.782900 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ngr7w_9ae8c206-b699-464a-8c38-415d074fe591/manager/0.log" Jun 09 12:22:07.809672 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:07.809642 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86976b546f-66bm8_85eda9fa-3354-48d9-bdf5-b32e6765e958/manager/0.log" Jun 09 12:22:07.833252 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:07.833219 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86976b546f-66bm8_85eda9fa-3354-48d9-bdf5-b32e6765e958/copy-manifests/0.log" Jun 09 12:22:08.078420 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:08.078333 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-d499c_71a93fcf-5fcc-4168-a8d4-cf2706be5151/postgres/0.log" Jun 09 12:22:12.755779 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:12.755740 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f6h64_5f27d741-7ee4-40f6-9990-6d93b721a9be/discovery/0.log" Jun 09 12:22:12.785284 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:12.785254 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd697648d-lpvwp_61acf8bc-bb39-4c2d-a3ee-a69958079c1f/kube-auth-proxy/0.log" Jun 09 12:22:12.895128 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:12.895095 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b557d5689-j6d6t_b44287d9-a75c-4f23-8f8e-afd6f07dd79e/router/0.log" Jun 09 12:22:14.078188 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:14.078150 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f6h64_5f27d741-7ee4-40f6-9990-6d93b721a9be/discovery/0.log" Jun 09 12:22:14.106514 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:14.106483 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd697648d-lpvwp_61acf8bc-bb39-4c2d-a3ee-a69958079c1f/kube-auth-proxy/0.log" Jun 09 12:22:14.222159 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:14.222130 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b557d5689-j6d6t_b44287d9-a75c-4f23-8f8e-afd6f07dd79e/router/0.log" Jun 09 12:22:15.296391 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:15.296360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vchkh_c75c82e4-bc79-4c6d-89fc-72363719a044/migrator/0.log" Jun 09 12:22:15.324164 ip-10-0-141-91 kubenswrapper[2562]: I0609 12:22:15.324134 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vchkh_c75c82e4-bc79-4c6d-89fc-72363719a044/graceful-termination/0.log"