Jun 14 20:15:39.747678 ip-10-0-132-94 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 20:15:39.747689 ip-10-0-132-94 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 20:15:39.747698 ip-10-0-132-94 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 20:15:39.747995 ip-10-0-132-94 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 20:15:49.875369 ip-10-0-132-94 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 14 20:15:49.875391 ip-10-0-132-94 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8314b49b60cd44c0974323cf7c65f8ad -- Jun 14 20:18:11.107114 ip-10-0-132-94 systemd[1]: Starting Kubernetes Kubelet... Jun 14 20:18:11.467696 ip-10-0-132-94 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 20:18:11.467696 ip-10-0-132-94 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 20:18:11.467696 ip-10-0-132-94 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 20:18:11.467696 ip-10-0-132-94 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 20:18:11.467696 ip-10-0-132-94 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 20:18:11.469894 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.469824 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 20:18:11.473831 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473814 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:11.473831 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473830 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:11.473831 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473835 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473839 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473844 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473847 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473851 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473855 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473859 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473862 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473866 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473870 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473874 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473882 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473887 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473892 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473896 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473901 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473905 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473909 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473920 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473924 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:11.474013 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473928 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473933 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473937 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473942 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473946 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473950 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473954 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473958 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473962 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473966 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473971 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473975 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473979 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473983 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473988 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473993 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.473997 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474002 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474006 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474010 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:11.474861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474015 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474019 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474023 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474028 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474032 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474036 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474040 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474045 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474049 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474053 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474057 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474061 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474066 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474070 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474074 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474078 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474082 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474086 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474091 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474095 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:11.475724 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474099 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474103 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474110 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474114 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474118 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474122 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474127 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474131 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474136 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474141 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474146 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474150 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474154 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474159 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474163 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474168 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474173 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474177 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474181 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:11.476551 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474189 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474194 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474199 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474203 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474207 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474212 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474216 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474220 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474225 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474231 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474237 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474242 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474246 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474251 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474255 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474260 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474265 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.474270 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475427 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:11.477046 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475439 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475444 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475448 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475452 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475457 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475462 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475467 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475471 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475476 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475481 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475485 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475489 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475494 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475498 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475502 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475509 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475514 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475520 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475525 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:11.477516 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475529 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475534 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475538 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475542 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475546 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475550 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475554 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475558 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475562 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475567 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475572 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475576 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475581 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475585 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475590 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475594 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475598 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475602 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475610 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:11.478012 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475616 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475621 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475626 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475631 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475636 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475640 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475645 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475651 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475656 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475661 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475665 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475669 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475673 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475677 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475681 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475686 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475690 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475694 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475698 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475702 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:11.478468 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475706 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475711 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475715 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475719 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475723 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475727 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475731 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475735 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475740 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475745 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475748 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475754 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475758 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475763 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475767 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475772 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475778 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475782 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475786 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475791 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:11.478973 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475811 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475816 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475820 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475824 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475828 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475832 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475836 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475840 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475844 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475848 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475853 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475856 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475861 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475865 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475870 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475874 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475878 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475882 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475887 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.475892 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:11.479482 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476449 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476456 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476462 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476466 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476471 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476475 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476496 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476518 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476522 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476526 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476529 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476532 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476535 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476538 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476541 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476543 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476546 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476549 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476552 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476555 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:11.479983 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476558 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476561 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476566 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476570 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476574 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476577 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476580 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476583 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476586 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476588 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476591 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476595 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476598 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476601 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476604 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476606 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476609 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476612 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476614 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:11.480461 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476619 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476623 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476626 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476628 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476633 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476636 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476640 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476643 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476646 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476650 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476652 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476655 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476658 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476660 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476663 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476666 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476668 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476671 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476674 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:11.480976 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476677 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476679 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476682 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476684 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476687 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476690 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476693 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476695 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476698 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476701 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476704 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476706 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476709 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476712 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476715 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476718 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476721 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476723 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476726 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476730 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:11.481431 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476733 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476736 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476738 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476741 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476743 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476746 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476749 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476752 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476754 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476757 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476759 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476762 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476764 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476767 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476769 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476772 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476775 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476778 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476781 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476784 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:11.482010 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.476786 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476866 2549 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476874 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476880 2549 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476884 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476888 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476892 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476896 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476900 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476904 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476906 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476910 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476913 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476916 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476919 2549 flags.go:64] FLAG: --cgroup-root="" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476922 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476926 2549 flags.go:64] FLAG: --client-ca-file="" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476929 2549 flags.go:64] FLAG: --cloud-provider="external" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476931 2549 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476935 2549 flags.go:64] FLAG: --cluster-domain="" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476938 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476941 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476944 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476947 2549 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 20:18:11.482524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476951 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476954 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476957 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476960 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476963 2549 flags.go:64] FLAG: --contention-profiling="false" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476967 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476970 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476973 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476976 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476980 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476983 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476986 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476989 2549 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476992 2549 flags.go:64] FLAG: --enable-server="true" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.476995 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477000 2549 flags.go:64] FLAG: --event-burst="100" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477003 2549 flags.go:64] FLAG: --event-qps="50" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477007 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477009 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477013 2549 flags.go:64] FLAG: --eviction-hard="" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477016 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477019 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477022 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477025 2549 flags.go:64] FLAG: --eviction-soft="" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477028 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 20:18:11.483127 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477031 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477034 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477037 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477040 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477043 2549 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477046 2549 flags.go:64] FLAG: --feature-gates="" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477050 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477053 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477056 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477059 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477062 2549 flags.go:64] FLAG: --healthz-port="10248" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477067 2549 flags.go:64] FLAG: --help="false" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477070 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477073 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477076 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477079 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477083 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477086 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477089 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477092 2549 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477095 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477098 2549 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477101 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477104 2549 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 20:18:11.483767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477107 2549 flags.go:64] FLAG: --kube-reserved="" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477111 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477113 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477116 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477119 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477122 2549 flags.go:64] FLAG: --lock-file="" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477125 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477127 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477130 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477136 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477139 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477141 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477144 2549 flags.go:64] FLAG: --logging-format="text" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477147 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477150 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477153 2549 flags.go:64] FLAG: --manifest-url="" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477156 2549 flags.go:64] FLAG: --manifest-url-header="" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477160 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477163 2549 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477169 2549 flags.go:64] FLAG: --max-pods="110" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477172 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477175 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477178 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477181 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477184 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 20:18:11.484365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477187 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477190 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477197 2549 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477200 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477203 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477206 2549 flags.go:64] FLAG: --pod-cidr="" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477209 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477214 2549 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477217 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477220 2549 flags.go:64] FLAG: --pods-per-core="0" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477223 2549 flags.go:64] FLAG: --port="10250" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477226 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477229 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-043cac50752aeb61c" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477232 2549 flags.go:64] FLAG: --qos-reserved="" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477235 2549 flags.go:64] FLAG: --read-only-port="10255" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477238 2549 flags.go:64] FLAG: --register-node="true" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477241 2549 flags.go:64] FLAG: --register-with-taints="" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477245 2549 flags.go:64] FLAG: --registry-burst="10" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477248 2549 flags.go:64] FLAG: --registry-qps="5" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477250 2549 flags.go:64] FLAG: --reserved-cpus="" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477253 2549 flags.go:64] FLAG: --reserved-memory="" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477257 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477260 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477263 2549 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477266 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 20:18:11.484988 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477268 2549 flags.go:64] FLAG: --runonce="false" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477273 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477276 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477279 2549 flags.go:64] FLAG: --seccomp-default="false" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477282 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477285 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477288 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477291 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477294 2549 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477297 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477300 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477303 2549 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477306 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477309 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477312 2549 flags.go:64] FLAG: --system-cgroups="" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477315 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477321 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477324 2549 flags.go:64] FLAG: --tls-cert-file="" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477327 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477331 2549 flags.go:64] FLAG: --tls-min-version="" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477334 2549 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477337 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477339 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477342 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477345 2549 flags.go:64] FLAG: --v="2" Jun 14 20:18:11.485590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477349 2549 flags.go:64] FLAG: --version="false" Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477353 2549 flags.go:64] FLAG: --vmodule="" Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477356 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.477359 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477466 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477470 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477473 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477476 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477480 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477484 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477488 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477491 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477494 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477498 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477501 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477504 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477507 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477510 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477512 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477515 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:11.486251 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477518 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477521 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477524 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477526 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477529 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477533 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477536 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477539 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477543 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477546 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477549 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477552 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477554 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477557 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477559 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477562 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477565 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477567 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477570 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477572 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:11.486731 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477577 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477579 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477582 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477584 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477587 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477591 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477594 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477596 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477599 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477602 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477604 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477607 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477609 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477612 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477615 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477617 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477620 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477623 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477625 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477628 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:11.487256 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477631 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477634 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477636 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477639 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477641 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477644 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477647 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477650 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477653 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477655 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477658 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477660 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477664 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477667 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477669 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477672 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477674 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477679 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477682 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:11.487734 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477684 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477687 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477689 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477694 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477697 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477700 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477703 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477706 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477709 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477712 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477715 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477718 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477721 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477724 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477727 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477730 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477732 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477735 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477737 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477740 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:11.488354 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477743 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477745 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477748 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.477751 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.478283 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.485206 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.485221 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.485239 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.485245 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485294 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485298 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485302 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485304 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485307 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485310 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:11.489002 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485312 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485315 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485317 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485320 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485322 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485325 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485328 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485331 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485334 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485337 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485339 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485341 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485346 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485350 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485353 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485356 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485359 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485361 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485364 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:11.489382 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485366 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485369 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485371 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485374 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485378 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485381 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485384 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485386 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485389 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485391 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485394 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485396 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485399 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485403 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485406 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485409 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485412 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485415 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485417 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:11.489848 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485420 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485422 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485425 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485427 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485430 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485432 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485434 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485437 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485439 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485442 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485444 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485447 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485449 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485452 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485454 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485457 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485459 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485463 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485466 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485469 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:11.490317 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485471 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485474 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485477 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485479 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485482 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485484 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485486 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485489 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485491 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485494 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485496 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485499 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485501 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485504 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485506 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485509 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485511 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485514 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485516 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485518 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:11.490790 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485521 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485523 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485526 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485528 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485531 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485533 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485536 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485539 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485542 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485545 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485547 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485551 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485553 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485555 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485558 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:11.491291 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.485563 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485685 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485689 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485692 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485695 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485698 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485700 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485703 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485705 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485708 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485710 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485713 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485716 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485719 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485721 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485723 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485726 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485729 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485731 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:11.491691 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485734 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485736 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485739 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485741 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485744 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485746 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485749 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485751 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485754 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485756 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485759 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485762 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485764 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485766 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485770 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485774 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485777 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485780 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485783 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:11.492262 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485786 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485789 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485806 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485809 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485812 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485815 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485817 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485820 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485822 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485825 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485827 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485830 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485832 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485835 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485837 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485840 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485842 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485846 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485850 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485853 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:11.492718 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485856 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485858 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485861 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485863 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485866 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485869 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485871 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485874 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485877 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485879 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485882 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485884 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485887 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485889 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485892 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485894 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485897 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485899 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485902 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485904 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:11.493211 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485907 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485910 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485912 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485915 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485917 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485920 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485922 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485925 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485927 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485930 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485932 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485935 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485938 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485941 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485943 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485945 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485948 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485951 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485954 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485956 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:11.493700 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485958 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:11.494270 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:11.485961 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:11.494270 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.485965 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 20:18:11.494270 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.486063 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 20:18:11.494270 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.489431 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 20:18:11.494270 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.490710 2549 server.go:1019] "Starting client certificate rotation" Jun 14 20:18:11.494270 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.490821 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 20:18:11.494270 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.490850 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 20:18:11.494270 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.493078 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 20:18:11.498185 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.498167 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 20:18:11.508524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.508510 2549 log.go:25] "Validated CRI v1 runtime API" Jun 14 20:18:11.511178 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.511165 2549 log.go:25] "Validated CRI v1 image API" Jun 14 20:18:11.511784 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.511770 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 20:18:11.511991 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.511975 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 20:18:11.516635 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.516618 2549 fs.go:135] Filesystem UUIDs: map[6e03be6d-e8ac-4098-9fd2-0a006b888a95:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c784aa73-bcc7-4138-8eff-f8501c06c561:/dev/nvme0n1p4] Jun 14 20:18:11.516699 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.516635 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 20:18:11.522294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.522197 2549 manager.go:216] Machine: {Timestamp:2026-06-14 20:18:11.520917626 +0000 UTC m=+0.305394227 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097045 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2098b504763b5d5413b483d5deed29 SystemUUID:ec2098b5-0476-3b5d-5413-b483d5deed29 BootID:8314b49b-60cd-44c0-9743-23cf7c65f8ad Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3c:f7:74:e0:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3c:f7:74:e0:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:c9:33:1c:3c:77 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 20:18:11.522294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.522293 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 20:18:11.522408 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.522382 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 20:18:11.524328 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.524303 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 20:18:11.524452 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.524331 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-94.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 20:18:11.524923 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.524913 2549 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 20:18:11.524953 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.524925 2549 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 20:18:11.524953 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.524932 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 20:18:11.525507 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.525498 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 20:18:11.526579 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.526569 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 20:18:11.529263 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.529252 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 14 20:18:11.529365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.529355 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 20:18:11.529394 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.529382 2549 kubelet.go:486] "Attempting to sync node with API server" Jun 14 20:18:11.529394 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.529391 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 20:18:11.529457 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.529401 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 20:18:11.529457 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.529409 2549 kubelet.go:398] "Adding apiserver pod source" Jun 14 20:18:11.529457 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.529416 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 20:18:11.529703 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.529689 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 20:18:11.529761 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.529712 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 20:18:11.532724 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.532706 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 20:18:11.533925 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.533910 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 20:18:11.534004 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.533942 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 20:18:11.534093 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534082 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 20:18:11.534125 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534102 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 20:18:11.534125 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534109 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 20:18:11.534125 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534114 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 20:18:11.534125 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534122 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 20:18:11.534221 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534128 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 20:18:11.534536 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534528 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 20:18:11.534565 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534537 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 20:18:11.534565 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534543 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 20:18:11.534565 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534548 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 20:18:11.534565 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534556 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 20:18:11.534565 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.534563 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 20:18:11.535202 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.535189 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 20:18:11.535202 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.535203 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 20:18:11.537721 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.537704 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffsnr" Jun 14 20:18:11.538292 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.538275 2549 server.go:1268] "Started kubelet" Jun 14 20:18:11.538429 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.538390 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 20:18:11.538532 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.538490 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 20:18:11.538652 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.538554 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 20:18:11.539325 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.539303 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-94.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 20:18:11.539428 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.539325 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 20:18:11.539428 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.539398 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 20:18:11.539352 ip-10-0-132-94 systemd[1]: Started Kubernetes Kubelet. Jun 14 20:18:11.540219 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.540139 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 20:18:11.540733 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.540718 2549 server.go:310] "Adding debug handlers to kubelet server" Jun 14 20:18:11.544573 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.543724 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-94.ec2.internal.18b90bf8f7c26a11 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-94.ec2.internal,UID:ip-10-0-132-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-94.ec2.internal,},FirstTimestamp:2026-06-14 20:18:11.538250257 +0000 UTC m=+0.322726900,LastTimestamp:2026-06-14 20:18:11.538250257 +0000 UTC m=+0.322726900,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-94.ec2.internal,}" Jun 14 20:18:11.544755 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.544740 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffsnr" Jun 14 20:18:11.544922 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.544904 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 20:18:11.544922 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.544916 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 20:18:11.545037 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.545005 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:11.545692 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.545675 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 20:18:11.545852 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.545843 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 20:18:11.546397 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.546379 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 20:18:11.546496 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.545895 2549 factory.go:55] Registering systemd factory Jun 14 20:18:11.546551 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.546505 2549 factory.go:223] Registration of the systemd container factory successfully Jun 14 20:18:11.546630 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.546617 2549 reconstruct.go:97] "Volume reconstruction finished" Jun 14 20:18:11.546630 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.546629 2549 reconciler.go:29] "Reconciler: start to sync state" Jun 14 20:18:11.546807 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.546768 2549 factory.go:153] Registering CRI-O factory Jun 14 20:18:11.546890 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.546820 2549 factory.go:223] Registration of the crio container factory successfully Jun 14 20:18:11.546890 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.546866 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 20:18:11.546890 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.546888 2549 factory.go:103] Registering Raw factory Jun 14 20:18:11.547033 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.546901 2549 manager.go:1196] Started watching for new ooms in manager Jun 14 20:18:11.547525 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.547484 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 20:18:11.547773 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.547758 2549 manager.go:349] Starting recovery of all containers Jun 14 20:18:11.553305 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.553286 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:11.557289 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.557267 2549 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-94.ec2.internal\" not found" node="ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.561134 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.561119 2549 manager.go:354] Recovery completed Jun 14 20:18:11.562215 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.562198 2549 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 14 20:18:11.564967 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.564910 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:11.566703 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.566688 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:11.566703 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.566713 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:11.566860 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.566723 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:11.567261 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.567246 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 20:18:11.567261 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.567257 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:11.567401 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.567258 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 20:18:11.567401 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.567321 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 14 20:18:11.567971 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.567958 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:11.568030 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.567982 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:11.568030 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.567991 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:11.568428 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.568415 2549 policy_none.go:49] "None policy: Start" Jun 14 20:18:11.568480 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.568434 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 20:18:11.568480 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.568457 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 20:18:11.569395 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.569382 2549 policy_none.go:47] "Start" Jun 14 20:18:11.599493 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.599479 2549 manager.go:337] "Starting Device Plugin manager" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.599507 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.599515 2549 server.go:87] "Starting device plugin registration server" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.599729 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.599740 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.599867 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.599951 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.599961 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.600583 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.600630 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.611728 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.612782 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.612823 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.612841 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.612898 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 20:18:11.623294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.615311 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:11.700039 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.700020 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:11.700845 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.700829 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:11.700898 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.700865 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:11.700898 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.700879 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:11.700959 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.700900 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.708589 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.708575 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.708633 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.708595 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-94.ec2.internal\": node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:11.713927 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.713902 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal"] Jun 14 20:18:11.714003 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.713966 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:11.714710 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.714690 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:11.714821 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.714717 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:11.714821 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.714731 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:11.717108 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.717094 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:11.717227 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.717211 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.717272 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.717242 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:11.717767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.717719 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:11.717767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.717741 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:11.717767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.717754 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:11.717952 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.717773 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:11.717952 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.717791 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:11.717952 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.717818 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:11.719995 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.719981 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.720051 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.720005 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:11.720681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.720667 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:11.720735 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.720696 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:11.720735 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.720707 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:11.721597 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.721579 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:11.747115 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.747092 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db22b5783a611500b92a31fe328e36fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal\" (UID: \"db22b5783a611500b92a31fe328e36fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.747193 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.747116 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db22b5783a611500b92a31fe328e36fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal\" (UID: \"db22b5783a611500b92a31fe328e36fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.747193 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.747178 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e303832cd2012a08bddfe235a4cca33-config\") pod \"kube-apiserver-proxy-ip-10-0-132-94.ec2.internal\" (UID: \"0e303832cd2012a08bddfe235a4cca33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.748363 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.748349 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-94.ec2.internal\" not found" node="ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.752478 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.752465 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-94.ec2.internal\" not found" node="ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.822681 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.822662 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:11.847322 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.847303 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db22b5783a611500b92a31fe328e36fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal\" (UID: \"db22b5783a611500b92a31fe328e36fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.847393 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.847325 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db22b5783a611500b92a31fe328e36fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal\" (UID: \"db22b5783a611500b92a31fe328e36fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.847393 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.847340 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e303832cd2012a08bddfe235a4cca33-config\") pod \"kube-apiserver-proxy-ip-10-0-132-94.ec2.internal\" (UID: \"0e303832cd2012a08bddfe235a4cca33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.847393 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.847368 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e303832cd2012a08bddfe235a4cca33-config\") pod \"kube-apiserver-proxy-ip-10-0-132-94.ec2.internal\" (UID: \"0e303832cd2012a08bddfe235a4cca33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.847487 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.847396 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db22b5783a611500b92a31fe328e36fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal\" (UID: \"db22b5783a611500b92a31fe328e36fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.847487 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:11.847411 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db22b5783a611500b92a31fe328e36fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal\" (UID: \"db22b5783a611500b92a31fe328e36fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" Jun 14 20:18:11.923486 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:11.923459 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:12.024058 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:12.024019 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:12.050654 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.050637 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" Jun 14 20:18:12.055715 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.055700 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal" Jun 14 20:18:12.124984 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:12.124963 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:12.225442 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:12.225422 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:12.325924 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:12.325881 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:12.426473 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:12.426453 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:12.489977 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.489958 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 20:18:12.490484 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.490105 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 20:18:12.490484 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.490119 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 20:18:12.527257 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:12.527236 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-94.ec2.internal\" not found" Jun 14 20:18:12.538008 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.537992 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:12.545639 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.545618 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal" Jun 14 20:18:12.545743 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.545643 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 20:18:12.550352 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.550329 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 20:13:11 +0000 UTC" deadline="2028-01-23 15:57:43.441953115 +0000 UTC" Jun 14 20:18:12.550352 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.550350 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14107h39m30.891605372s" Jun 14 20:18:12.554603 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.554587 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 20:18:12.556168 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.556154 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" Jun 14 20:18:12.556905 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.556887 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 20:18:12.562989 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:12.562968 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e303832cd2012a08bddfe235a4cca33.slice/crio-dcea24fc06be76f99f05c5d4babcbe4b81ef0855a3e8cfa1e2422147c57b5671 WatchSource:0}: Error finding container dcea24fc06be76f99f05c5d4babcbe4b81ef0855a3e8cfa1e2422147c57b5671: Status 404 returned error can't find the container with id dcea24fc06be76f99f05c5d4babcbe4b81ef0855a3e8cfa1e2422147c57b5671 Jun 14 20:18:12.564523 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:12.564508 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb22b5783a611500b92a31fe328e36fa.slice/crio-30eb0cbffec3cae04d6bde4f4cf9ced2b7ccbac7bca5bbd8e04c4d07e0fcae0f WatchSource:0}: Error finding container 30eb0cbffec3cae04d6bde4f4cf9ced2b7ccbac7bca5bbd8e04c4d07e0fcae0f: Status 404 returned error can't find the container with id 30eb0cbffec3cae04d6bde4f4cf9ced2b7ccbac7bca5bbd8e04c4d07e0fcae0f Jun 14 20:18:12.565530 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.565517 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 20:18:12.567969 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.567957 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 20:18:12.584692 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.584653 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-97bsw" Jun 14 20:18:12.592078 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.592064 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-97bsw" Jun 14 20:18:12.615414 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.615370 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal" event={"ID":"0e303832cd2012a08bddfe235a4cca33","Type":"ContainerStarted","Data":"dcea24fc06be76f99f05c5d4babcbe4b81ef0855a3e8cfa1e2422147c57b5671"} Jun 14 20:18:12.616385 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.616359 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" event={"ID":"db22b5783a611500b92a31fe328e36fa","Type":"ContainerStarted","Data":"30eb0cbffec3cae04d6bde4f4cf9ced2b7ccbac7bca5bbd8e04c4d07e0fcae0f"} Jun 14 20:18:12.649130 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:12.649072 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:13.531200 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.531173 2549 apiserver.go:52] "Watching apiserver" Jun 14 20:18:13.540074 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.540048 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 20:18:13.541100 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.541075 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-8qzn7","openshift-image-registry/node-ca-phwh7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal","openshift-multus/multus-additional-cni-plugins-nwq64","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v","openshift-dns/node-resolver-t5jkg","openshift-multus/multus-qcwf4","openshift-multus/network-metrics-daemon-khjh8","openshift-network-diagnostics/network-check-target-rx2gw","openshift-network-operator/iptables-alerter-s5nfr","openshift-ovn-kubernetes/ovnkube-node-pwm4z","kube-system/global-pull-secret-syncer-fjz5r","kube-system/konnectivity-agent-r8zm6","kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal"] Jun 14 20:18:13.543500 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.543481 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.545822 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.545683 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:13.545931 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.545915 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 20:18:13.546132 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.546108 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 20:18:13.546382 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.546363 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 20:18:13.546482 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.546392 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 20:18:13.546482 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.546422 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jwdc7\"" Jun 14 20:18:13.547712 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.547680 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 20:18:13.548192 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.547926 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:13.548192 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.548010 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:13.548345 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.548252 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qfbdx\"" Jun 14 20:18:13.548345 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.548319 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 20:18:13.550087 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.550065 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.552149 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.552102 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tdcpn\"" Jun 14 20:18:13.552149 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.552139 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 20:18:13.552291 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.552140 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 20:18:13.553079 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.553009 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.555218 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.555092 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vj8g5\"" Jun 14 20:18:13.555218 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.555099 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 20:18:13.555447 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.555429 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 20:18:13.555524 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.555468 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 20:18:13.556287 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.556268 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.556995 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.556970 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-multus-socket-dir-parent\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557094 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557014 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-run-k8s-cni-cncf-io\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557094 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557044 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-var-lib-cni-multus\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557094 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557080 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-multus-conf-dir\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557235 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557144 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6790b23e-adb1-4356-ba9d-6ddb3b1208d2-agent-certs\") pod \"konnectivity-agent-r8zm6\" (UID: \"6790b23e-adb1-4356-ba9d-6ddb3b1208d2\") " pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:13.557235 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557225 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6790b23e-adb1-4356-ba9d-6ddb3b1208d2-konnectivity-ca\") pod \"konnectivity-agent-r8zm6\" (UID: \"6790b23e-adb1-4356-ba9d-6ddb3b1208d2\") " pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:13.557329 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557254 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-system-cni-dir\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557329 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557277 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-multus-cni-dir\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557329 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557312 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-cnibin\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557460 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557363 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-run-netns\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557460 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557394 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-etc-kubernetes\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557460 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557425 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-var-lib-cni-bin\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557591 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557454 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-var-lib-kubelet\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557591 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557505 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa01d48d-795e-410a-bf18-c059910f998f-multus-daemon-config\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557591 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557532 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-run-multus-certs\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557591 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557559 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g874p\" (UniqueName: \"kubernetes.io/projected/aa01d48d-795e-410a-bf18-c059910f998f-kube-api-access-g874p\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557591 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557579 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-os-release\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557781 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557603 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa01d48d-795e-410a-bf18-c059910f998f-cni-binary-copy\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557781 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557627 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbksd\" (UniqueName: \"kubernetes.io/projected/7c228186-a35c-4a42-8470-6eba1873b428-kube-api-access-mbksd\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:13.557781 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557663 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-hostroot\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.557781 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.557698 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:13.558413 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.558384 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-46lc6\"" Jun 14 20:18:13.558500 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.558413 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 20:18:13.558500 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.558413 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 20:18:13.558873 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.558857 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:13.559033 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.559006 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:13.561889 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.561871 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.564027 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.564007 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 20:18:13.564115 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.564029 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 20:18:13.564115 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.564036 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bmkwf\"" Jun 14 20:18:13.564310 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.564283 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.566470 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.566451 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 20:18:13.566546 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.566524 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m5xmq\"" Jun 14 20:18:13.566769 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.566743 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 20:18:13.570119 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.567680 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.570119 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.568066 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 20:18:13.570405 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.570378 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 20:18:13.570847 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.570501 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jxkm7\"" Jun 14 20:18:13.570847 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.570545 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 20:18:13.570847 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.570820 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.571026 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.570933 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 20:18:13.573012 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.572994 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 20:18:13.573820 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.573593 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 20:18:13.573820 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.573632 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9gch9\"" Jun 14 20:18:13.573820 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.573718 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 20:18:13.574683 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.574654 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 20:18:13.574772 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.574681 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:13.574772 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.574732 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:13.574891 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.574868 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 20:18:13.574929 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.574893 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 20:18:13.596353 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.596311 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 20:13:12 +0000 UTC" deadline="2027-12-14 00:29:00.148841617 +0000 UTC" Jun 14 20:18:13.596462 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.596355 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13132h10m46.552490412s" Jun 14 20:18:13.647963 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.647936 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 20:18:13.658129 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658106 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqqm6\" (UniqueName: \"kubernetes.io/projected/3163ba5a-f1ea-40e2-9534-af0a66adf0b5-kube-api-access-tqqm6\") pod \"iptables-alerter-s5nfr\" (UID: \"3163ba5a-f1ea-40e2-9534-af0a66adf0b5\") " pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.658232 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658137 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e825813b-b013-4787-bd50-3d0079d10a17-ovnkube-config\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.658232 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658157 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:13.658232 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658172 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-multus-socket-dir-parent\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.658232 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658188 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.658232 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658203 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658260 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv5ls\" (UniqueName: \"kubernetes.io/projected/a955861c-16a3-424c-95cf-aa772aad27c3-kube-api-access-lv5ls\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658261 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-multus-socket-dir-parent\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658292 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-multus-cni-dir\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658318 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-cnibin\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658340 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-run-netns\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.658345 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658365 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-system-cni-dir\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658370 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-multus-cni-dir\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658386 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a3f0d10-e063-4d46-8b37-56b372453e3f-host\") pod \"node-ca-phwh7\" (UID: \"5a3f0d10-e063-4d46-8b37-56b372453e3f\") " pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658399 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-cnibin\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.658420 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs podName:7c228186-a35c-4a42-8470-6eba1873b428 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:14.158384151 +0000 UTC m=+2.942860736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs") pod "network-metrics-daemon-khjh8" (UID: "7c228186-a35c-4a42-8470-6eba1873b428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658423 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-run-netns\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.658451 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658447 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7qpg\" (UniqueName: \"kubernetes.io/projected/5a3f0d10-e063-4d46-8b37-56b372453e3f-kube-api-access-f7qpg\") pod \"node-ca-phwh7\" (UID: \"5a3f0d10-e063-4d46-8b37-56b372453e3f\") " pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658473 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-node-log\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658509 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-var-lib-cni-bin\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658530 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-var-lib-kubelet\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658550 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa01d48d-795e-410a-bf18-c059910f998f-multus-daemon-config\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658571 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crzq2\" (UniqueName: \"kubernetes.io/projected/3316c4e5-2257-4221-af64-fbbf79dc69b2-kube-api-access-crzq2\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658581 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-var-lib-cni-bin\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658586 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-var-lib-kubelet\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658587 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9tx\" (UniqueName: \"kubernetes.io/projected/1ba15824-78cc-4d04-b901-a78ecc98bf99-kube-api-access-kk9tx\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658642 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3163ba5a-f1ea-40e2-9534-af0a66adf0b5-host-slash\") pod \"iptables-alerter-s5nfr\" (UID: \"3163ba5a-f1ea-40e2-9534-af0a66adf0b5\") " pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658672 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-run-ovn\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658698 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-log-socket\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658725 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa01d48d-795e-410a-bf18-c059910f998f-cni-binary-copy\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658747 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-hostroot\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658770 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-cnibin\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658791 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-host\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658838 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-sys-fs\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.659085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658875 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a3f0d10-e063-4d46-8b37-56b372453e3f-serviceca\") pod \"node-ca-phwh7\" (UID: \"5a3f0d10-e063-4d46-8b37-56b372453e3f\") " pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658899 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-cni-netd\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658843 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-hostroot\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658923 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658951 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-run-k8s-cni-cncf-io\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.658989 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-var-lib-cni-multus\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659012 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-run-k8s-cni-cncf-io\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659035 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3316c4e5-2257-4221-af64-fbbf79dc69b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659060 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-lib-modules\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659064 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-var-lib-cni-multus\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659092 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-run-openvswitch\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659114 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e825813b-b013-4787-bd50-3d0079d10a17-ovn-node-metrics-cert\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659130 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-systemd\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659144 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ba15824-78cc-4d04-b901-a78ecc98bf99-tmp\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659163 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa01d48d-795e-410a-bf18-c059910f998f-multus-daemon-config\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659182 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-dbus\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659203 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5jnw\" (UniqueName: \"kubernetes.io/projected/e825813b-b013-4787-bd50-3d0079d10a17-kube-api-access-m5jnw\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.659843 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659253 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g874p\" (UniqueName: \"kubernetes.io/projected/aa01d48d-795e-410a-bf18-c059910f998f-kube-api-access-g874p\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659267 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa01d48d-795e-410a-bf18-c059910f998f-cni-binary-copy\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659289 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-os-release\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659323 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-run\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659344 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-device-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659361 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq7bw\" (UniqueName: \"kubernetes.io/projected/25d26a18-3ece-43ad-9dcf-6d29b9ac79f6-kube-api-access-fq7bw\") pod \"node-resolver-t5jkg\" (UID: \"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6\") " pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659376 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-kubernetes\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659400 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-run-netns\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659459 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-run-systemd\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659492 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-multus-conf-dir\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659535 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-multus-conf-dir\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659565 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659591 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-var-lib-openvswitch\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659613 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-cni-bin\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659644 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e825813b-b013-4787-bd50-3d0079d10a17-ovnkube-script-lib\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659670 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6790b23e-adb1-4356-ba9d-6ddb3b1208d2-agent-certs\") pod \"konnectivity-agent-r8zm6\" (UID: \"6790b23e-adb1-4356-ba9d-6ddb3b1208d2\") " pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659698 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6790b23e-adb1-4356-ba9d-6ddb3b1208d2-konnectivity-ca\") pod \"konnectivity-agent-r8zm6\" (UID: \"6790b23e-adb1-4356-ba9d-6ddb3b1208d2\") " pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:13.660729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.659733 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660056 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660152 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6790b23e-adb1-4356-ba9d-6ddb3b1208d2-konnectivity-ca\") pod \"konnectivity-agent-r8zm6\" (UID: \"6790b23e-adb1-4356-ba9d-6ddb3b1208d2\") " pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660291 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-var-lib-kubelet\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660316 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-tuned\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660338 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-socket-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660367 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25d26a18-3ece-43ad-9dcf-6d29b9ac79f6-hosts-file\") pod \"node-resolver-t5jkg\" (UID: \"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6\") " pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660408 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-sysconfig\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660430 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-kubelet\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660452 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-etc-openvswitch\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660477 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3316c4e5-2257-4221-af64-fbbf79dc69b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660501 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3316c4e5-2257-4221-af64-fbbf79dc69b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660530 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-sys\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660553 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3163ba5a-f1ea-40e2-9534-af0a66adf0b5-iptables-alerter-script\") pod \"iptables-alerter-s5nfr\" (UID: \"3163ba5a-f1ea-40e2-9534-af0a66adf0b5\") " pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660592 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-systemd-units\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660624 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-slash\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660647 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.661403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660670 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-modprobe-d\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660697 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-sysctl-d\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660720 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-sysctl-conf\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660740 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660762 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-registration-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660789 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-system-cni-dir\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660833 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-etc-kubernetes\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660857 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-kubelet-config\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660868 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-system-cni-dir\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660878 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25d26a18-3ece-43ad-9dcf-6d29b9ac79f6-tmp-dir\") pod \"node-resolver-t5jkg\" (UID: \"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6\") " pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660906 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-run-multus-certs\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660935 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-etc-kubernetes\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660941 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e825813b-b013-4787-bd50-3d0079d10a17-env-overrides\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660985 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-host-run-multus-certs\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.660983 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-os-release\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.661026 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbksd\" (UniqueName: \"kubernetes.io/projected/7c228186-a35c-4a42-8470-6eba1873b428-kube-api-access-mbksd\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:13.661893 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.661051 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa01d48d-795e-410a-bf18-c059910f998f-os-release\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.663145 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.663129 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6790b23e-adb1-4356-ba9d-6ddb3b1208d2-agent-certs\") pod \"konnectivity-agent-r8zm6\" (UID: \"6790b23e-adb1-4356-ba9d-6ddb3b1208d2\") " pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:13.666643 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.666626 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g874p\" (UniqueName: \"kubernetes.io/projected/aa01d48d-795e-410a-bf18-c059910f998f-kube-api-access-g874p\") pod \"multus-qcwf4\" (UID: \"aa01d48d-795e-410a-bf18-c059910f998f\") " pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.668245 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.668219 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbksd\" (UniqueName: \"kubernetes.io/projected/7c228186-a35c-4a42-8470-6eba1873b428-kube-api-access-mbksd\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:13.761890 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.761863 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-kubelet-config\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:13.762064 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.761895 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25d26a18-3ece-43ad-9dcf-6d29b9ac79f6-tmp-dir\") pod \"node-resolver-t5jkg\" (UID: \"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6\") " pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.762064 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.761923 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e825813b-b013-4787-bd50-3d0079d10a17-env-overrides\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.762064 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.761949 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqqm6\" (UniqueName: \"kubernetes.io/projected/3163ba5a-f1ea-40e2-9534-af0a66adf0b5-kube-api-access-tqqm6\") pod \"iptables-alerter-s5nfr\" (UID: \"3163ba5a-f1ea-40e2-9534-af0a66adf0b5\") " pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.762064 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.761973 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e825813b-b013-4787-bd50-3d0079d10a17-ovnkube-config\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.762064 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.761982 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-kubelet-config\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:13.762064 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762009 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.762064 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762067 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.762360 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762154 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:13.762360 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762235 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25d26a18-3ece-43ad-9dcf-6d29b9ac79f6-tmp-dir\") pod \"node-resolver-t5jkg\" (UID: \"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6\") " pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.762360 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762266 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv5ls\" (UniqueName: \"kubernetes.io/projected/a955861c-16a3-424c-95cf-aa772aad27c3-kube-api-access-lv5ls\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.762360 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762293 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-system-cni-dir\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.762360 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762314 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a3f0d10-e063-4d46-8b37-56b372453e3f-host\") pod \"node-ca-phwh7\" (UID: \"5a3f0d10-e063-4d46-8b37-56b372453e3f\") " pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.762360 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762341 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7qpg\" (UniqueName: \"kubernetes.io/projected/5a3f0d10-e063-4d46-8b37-56b372453e3f-kube-api-access-f7qpg\") pod \"node-ca-phwh7\" (UID: \"5a3f0d10-e063-4d46-8b37-56b372453e3f\") " pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762381 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-system-cni-dir\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762419 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e825813b-b013-4787-bd50-3d0079d10a17-env-overrides\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762429 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a3f0d10-e063-4d46-8b37-56b372453e3f-host\") pod \"node-ca-phwh7\" (UID: \"5a3f0d10-e063-4d46-8b37-56b372453e3f\") " pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762477 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-node-log\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762510 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e825813b-b013-4787-bd50-3d0079d10a17-ovnkube-config\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762526 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-node-log\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762529 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crzq2\" (UniqueName: \"kubernetes.io/projected/3316c4e5-2257-4221-af64-fbbf79dc69b2-kube-api-access-crzq2\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762556 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9tx\" (UniqueName: \"kubernetes.io/projected/1ba15824-78cc-4d04-b901-a78ecc98bf99-kube-api-access-kk9tx\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762582 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3163ba5a-f1ea-40e2-9534-af0a66adf0b5-host-slash\") pod \"iptables-alerter-s5nfr\" (UID: \"3163ba5a-f1ea-40e2-9534-af0a66adf0b5\") " pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762600 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-run-ovn\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762617 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-log-socket\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.762628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762638 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-cnibin\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762652 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-host\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762652 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3163ba5a-f1ea-40e2-9534-af0a66adf0b5-host-slash\") pod \"iptables-alerter-s5nfr\" (UID: \"3163ba5a-f1ea-40e2-9534-af0a66adf0b5\") " pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762702 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-run-ovn\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762722 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-sys-fs\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762729 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-log-socket\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762666 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-sys-fs\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762755 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-cnibin\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762765 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a3f0d10-e063-4d46-8b37-56b372453e3f-serviceca\") pod \"node-ca-phwh7\" (UID: \"5a3f0d10-e063-4d46-8b37-56b372453e3f\") " pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762808 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-cni-netd\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762821 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-host\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762839 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762863 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-cni-netd\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762868 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3316c4e5-2257-4221-af64-fbbf79dc69b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762894 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-lib-modules\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762897 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762924 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-run-openvswitch\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.763253 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762945 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e825813b-b013-4787-bd50-3d0079d10a17-ovn-node-metrics-cert\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762964 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-systemd\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.762983 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ba15824-78cc-4d04-b901-a78ecc98bf99-tmp\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763006 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-dbus\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763007 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-lib-modules\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763031 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5jnw\" (UniqueName: \"kubernetes.io/projected/e825813b-b013-4787-bd50-3d0079d10a17-kube-api-access-m5jnw\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763057 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-systemd\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763057 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-os-release\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763074 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a3f0d10-e063-4d46-8b37-56b372453e3f-serviceca\") pod \"node-ca-phwh7\" (UID: \"5a3f0d10-e063-4d46-8b37-56b372453e3f\") " pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763090 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-run\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763109 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-os-release\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763114 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-device-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763139 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7bw\" (UniqueName: \"kubernetes.io/projected/25d26a18-3ece-43ad-9dcf-6d29b9ac79f6-kube-api-access-fq7bw\") pod \"node-resolver-t5jkg\" (UID: \"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6\") " pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763163 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-kubernetes\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763189 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-run-netns\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763221 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-run-systemd\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763246 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:13.764191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763270 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-var-lib-openvswitch\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763328 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-var-lib-openvswitch\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763350 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-dbus\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763350 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-run\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763357 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-kubernetes\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763005 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-run-openvswitch\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763370 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-run-systemd\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763402 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-device-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763418 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-cni-bin\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.763435 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763455 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e825813b-b013-4787-bd50-3d0079d10a17-ovnkube-script-lib\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763484 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763489 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3316c4e5-2257-4221-af64-fbbf79dc69b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.763504 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret podName:1e0406b2-ebe5-4cb4-8b2a-2bd53a184704 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:14.263487548 +0000 UTC m=+3.047964129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret") pod "global-pull-secret-syncer-fjz5r" (UID: "1e0406b2-ebe5-4cb4-8b2a-2bd53a184704") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763489 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-cni-bin\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763457 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-run-netns\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763539 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-var-lib-kubelet\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.765083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763563 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-tuned\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763593 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-socket-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763604 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-var-lib-kubelet\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763623 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3316c4e5-2257-4221-af64-fbbf79dc69b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763618 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25d26a18-3ece-43ad-9dcf-6d29b9ac79f6-hosts-file\") pod \"node-resolver-t5jkg\" (UID: \"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6\") " pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763664 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-sysconfig\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763681 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25d26a18-3ece-43ad-9dcf-6d29b9ac79f6-hosts-file\") pod \"node-resolver-t5jkg\" (UID: \"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6\") " pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763688 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-kubelet\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763695 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-socket-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763715 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-etc-openvswitch\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763730 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-sysconfig\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763740 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3316c4e5-2257-4221-af64-fbbf79dc69b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763771 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-kubelet\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763789 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-etc-openvswitch\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763765 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3316c4e5-2257-4221-af64-fbbf79dc69b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763850 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-sys\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763874 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3163ba5a-f1ea-40e2-9534-af0a66adf0b5-iptables-alerter-script\") pod \"iptables-alerter-s5nfr\" (UID: \"3163ba5a-f1ea-40e2-9534-af0a66adf0b5\") " pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.765980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763897 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-systemd-units\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763921 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-slash\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763969 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e825813b-b013-4787-bd50-3d0079d10a17-ovnkube-script-lib\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.763981 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-systemd-units\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764011 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764034 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-modprobe-d\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764040 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-sys\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764058 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-sysctl-d\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764083 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-sysctl-conf\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764108 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764131 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-registration-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764186 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-modprobe-d\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764221 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-registration-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764082 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764279 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a955861c-16a3-424c-95cf-aa772aad27c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764286 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3316c4e5-2257-4221-af64-fbbf79dc69b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764310 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e825813b-b013-4787-bd50-3d0079d10a17-host-slash\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.766681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764323 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-sysctl-conf\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.767341 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764350 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3163ba5a-f1ea-40e2-9534-af0a66adf0b5-iptables-alerter-script\") pod \"iptables-alerter-s5nfr\" (UID: \"3163ba5a-f1ea-40e2-9534-af0a66adf0b5\") " pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.767341 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764365 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-sysctl-d\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.767341 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.764672 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3316c4e5-2257-4221-af64-fbbf79dc69b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.767341 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.766433 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ba15824-78cc-4d04-b901-a78ecc98bf99-tmp\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.767341 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.766489 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ba15824-78cc-4d04-b901-a78ecc98bf99-etc-tuned\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.767341 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.766522 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e825813b-b013-4787-bd50-3d0079d10a17-ovn-node-metrics-cert\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.770093 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.770073 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqqm6\" (UniqueName: \"kubernetes.io/projected/3163ba5a-f1ea-40e2-9534-af0a66adf0b5-kube-api-access-tqqm6\") pod \"iptables-alerter-s5nfr\" (UID: \"3163ba5a-f1ea-40e2-9534-af0a66adf0b5\") " pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.771938 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.771914 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:13.771938 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.771940 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:13.772101 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.771971 2549 projected.go:196] Error preparing data for projected volume kube-api-access-8k2gt for pod openshift-network-diagnostics/network-check-target-rx2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:13.772101 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:13.772033 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt podName:5abbc5fc-7987-449a-93c9-ade9e2cc16c7 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:14.272016295 +0000 UTC m=+3.056492864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8k2gt" (UniqueName: "kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt") pod "network-check-target-rx2gw" (UID: "5abbc5fc-7987-449a-93c9-ade9e2cc16c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:13.774221 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.774195 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5jnw\" (UniqueName: \"kubernetes.io/projected/e825813b-b013-4787-bd50-3d0079d10a17-kube-api-access-m5jnw\") pod \"ovnkube-node-pwm4z\" (UID: \"e825813b-b013-4787-bd50-3d0079d10a17\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:13.775198 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.775177 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7qpg\" (UniqueName: \"kubernetes.io/projected/5a3f0d10-e063-4d46-8b37-56b372453e3f-kube-api-access-f7qpg\") pod \"node-ca-phwh7\" (UID: \"5a3f0d10-e063-4d46-8b37-56b372453e3f\") " pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.775310 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.775202 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq7bw\" (UniqueName: \"kubernetes.io/projected/25d26a18-3ece-43ad-9dcf-6d29b9ac79f6-kube-api-access-fq7bw\") pod \"node-resolver-t5jkg\" (UID: \"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6\") " pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.775310 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.775268 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9tx\" (UniqueName: \"kubernetes.io/projected/1ba15824-78cc-4d04-b901-a78ecc98bf99-kube-api-access-kk9tx\") pod \"tuned-8qzn7\" (UID: \"1ba15824-78cc-4d04-b901-a78ecc98bf99\") " pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.775989 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.775967 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv5ls\" (UniqueName: \"kubernetes.io/projected/a955861c-16a3-424c-95cf-aa772aad27c3-kube-api-access-lv5ls\") pod \"aws-ebs-csi-driver-node-lx79v\" (UID: \"a955861c-16a3-424c-95cf-aa772aad27c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.776457 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.776438 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crzq2\" (UniqueName: \"kubernetes.io/projected/3316c4e5-2257-4221-af64-fbbf79dc69b2-kube-api-access-crzq2\") pod \"multus-additional-cni-plugins-nwq64\" (UID: \"3316c4e5-2257-4221-af64-fbbf79dc69b2\") " pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.817590 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.817509 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:13.855675 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.855640 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qcwf4" Jun 14 20:18:13.862681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.862655 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:13.874486 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.874470 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nwq64" Jun 14 20:18:13.880317 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.880295 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" Jun 14 20:18:13.887175 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.887160 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5jkg" Jun 14 20:18:13.893938 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.893922 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" Jun 14 20:18:13.901621 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.901604 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-phwh7" Jun 14 20:18:13.908396 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.908378 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5nfr" Jun 14 20:18:13.913148 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:13.913127 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:14.036038 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.036012 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:14.166686 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.166609 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:14.166851 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.166733 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:14.166851 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.166813 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs podName:7c228186-a35c-4a42-8470-6eba1873b428 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:15.166779857 +0000 UTC m=+3.951256439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs") pod "network-metrics-daemon-khjh8" (UID: "7c228186-a35c-4a42-8470-6eba1873b428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:14.267847 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.267807 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:14.268040 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.267952 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:14.268040 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.268022 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret podName:1e0406b2-ebe5-4cb4-8b2a-2bd53a184704 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:15.268003281 +0000 UTC m=+4.052479855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret") pod "global-pull-secret-syncer-fjz5r" (UID: "1e0406b2-ebe5-4cb4-8b2a-2bd53a184704") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:14.346032 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:14.346001 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3316c4e5_2257_4221_af64_fbbf79dc69b2.slice/crio-1d3a12648e2b7ef85fa332ee4e29bf52be8b646e435d3358cbde85f263e9f0db WatchSource:0}: Error finding container 1d3a12648e2b7ef85fa332ee4e29bf52be8b646e435d3358cbde85f263e9f0db: Status 404 returned error can't find the container with id 1d3a12648e2b7ef85fa332ee4e29bf52be8b646e435d3358cbde85f263e9f0db Jun 14 20:18:14.346748 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:14.346724 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d26a18_3ece_43ad_9dcf_6d29b9ac79f6.slice/crio-b74c5597d3a8805f0ee598ace52f3a69f985e07ceb975b4be544960c0d945503 WatchSource:0}: Error finding container b74c5597d3a8805f0ee598ace52f3a69f985e07ceb975b4be544960c0d945503: Status 404 returned error can't find the container with id b74c5597d3a8805f0ee598ace52f3a69f985e07ceb975b4be544960c0d945503 Jun 14 20:18:14.350895 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:14.350873 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda955861c_16a3_424c_95cf_aa772aad27c3.slice/crio-e94f21a5a4f0d8c117e49d29a89324d57d000c7fd140a049313b7a4220b721da WatchSource:0}: Error finding container e94f21a5a4f0d8c117e49d29a89324d57d000c7fd140a049313b7a4220b721da: Status 404 returned error can't find the container with id e94f21a5a4f0d8c117e49d29a89324d57d000c7fd140a049313b7a4220b721da Jun 14 20:18:14.351547 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:14.351526 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3163ba5a_f1ea_40e2_9534_af0a66adf0b5.slice/crio-06091add866226a3b99a0591c9bf495e521b23e2be74919009631b99d88c1a81 WatchSource:0}: Error finding container 06091add866226a3b99a0591c9bf495e521b23e2be74919009631b99d88c1a81: Status 404 returned error can't find the container with id 06091add866226a3b99a0591c9bf495e521b23e2be74919009631b99d88c1a81 Jun 14 20:18:14.353087 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:14.352994 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3f0d10_e063_4d46_8b37_56b372453e3f.slice/crio-3bdcc85262aeec505699bfeeb8ae267f272b64e700a08360471e7d9dc48b089b WatchSource:0}: Error finding container 3bdcc85262aeec505699bfeeb8ae267f272b64e700a08360471e7d9dc48b089b: Status 404 returned error can't find the container with id 3bdcc85262aeec505699bfeeb8ae267f272b64e700a08360471e7d9dc48b089b Jun 14 20:18:14.353895 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:14.353692 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6790b23e_adb1_4356_ba9d_6ddb3b1208d2.slice/crio-0c434a7cc8947a5fcdcdd013b99177f64d4416846614c9bcc9a5a63806785aa6 WatchSource:0}: Error finding container 0c434a7cc8947a5fcdcdd013b99177f64d4416846614c9bcc9a5a63806785aa6: Status 404 returned error can't find the container with id 0c434a7cc8947a5fcdcdd013b99177f64d4416846614c9bcc9a5a63806785aa6 Jun 14 20:18:14.354145 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:14.354122 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa01d48d_795e_410a_bf18_c059910f998f.slice/crio-39bcc2cb4fcac1f30a41781163ec330b10d8f1ff0ec3a778d0e270e740602461 WatchSource:0}: Error finding container 39bcc2cb4fcac1f30a41781163ec330b10d8f1ff0ec3a778d0e270e740602461: Status 404 returned error can't find the container with id 39bcc2cb4fcac1f30a41781163ec330b10d8f1ff0ec3a778d0e270e740602461 Jun 14 20:18:14.356399 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:14.355681 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode825813b_b013_4787_bd50_3d0079d10a17.slice/crio-ff58870b2e31e6db9d16de1fccffcef28f65b77c86fdb8e2c8968b08363acc96 WatchSource:0}: Error finding container ff58870b2e31e6db9d16de1fccffcef28f65b77c86fdb8e2c8968b08363acc96: Status 404 returned error can't find the container with id ff58870b2e31e6db9d16de1fccffcef28f65b77c86fdb8e2c8968b08363acc96 Jun 14 20:18:14.356984 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:14.356639 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba15824_78cc_4d04_b901_a78ecc98bf99.slice/crio-22562cf0df63452ca91e93c7d0e3ac49f9447740b5b1b4f3c2d9f788e32f04cc WatchSource:0}: Error finding container 22562cf0df63452ca91e93c7d0e3ac49f9447740b5b1b4f3c2d9f788e32f04cc: Status 404 returned error can't find the container with id 22562cf0df63452ca91e93c7d0e3ac49f9447740b5b1b4f3c2d9f788e32f04cc Jun 14 20:18:14.368592 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.368568 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:14.368706 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.368693 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:14.368749 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.368715 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:14.368749 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.368727 2549 projected.go:196] Error preparing data for projected volume kube-api-access-8k2gt for pod openshift-network-diagnostics/network-check-target-rx2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:14.368842 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.368776 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt podName:5abbc5fc-7987-449a-93c9-ade9e2cc16c7 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:15.368760077 +0000 UTC m=+4.153236661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8k2gt" (UniqueName: "kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt") pod "network-check-target-rx2gw" (UID: "5abbc5fc-7987-449a-93c9-ade9e2cc16c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:14.596519 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.596478 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 20:13:12 +0000 UTC" deadline="2027-12-11 19:48:44.736229425 +0000 UTC" Jun 14 20:18:14.596519 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.596518 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13079h30m30.139714591s" Jun 14 20:18:14.613839 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.613819 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:14.613920 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.613826 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:14.613964 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.613921 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:14.613996 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:14.613981 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:14.621086 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.621056 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" event={"ID":"db22b5783a611500b92a31fe328e36fa","Type":"ContainerDied","Data":"324ff9265b8f50a451118b23e24b5e14056b347d6e1525bd4f0d670e554c2fcf"} Jun 14 20:18:14.623609 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.621138 2549 generic.go:356] "Generic (PLEG): container finished" podID="db22b5783a611500b92a31fe328e36fa" containerID="324ff9265b8f50a451118b23e24b5e14056b347d6e1525bd4f0d670e554c2fcf" exitCode=0 Jun 14 20:18:14.624984 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.624955 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" event={"ID":"1ba15824-78cc-4d04-b901-a78ecc98bf99","Type":"ContainerStarted","Data":"22562cf0df63452ca91e93c7d0e3ac49f9447740b5b1b4f3c2d9f788e32f04cc"} Jun 14 20:18:14.626030 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.626004 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r8zm6" event={"ID":"6790b23e-adb1-4356-ba9d-6ddb3b1208d2","Type":"ContainerStarted","Data":"0c434a7cc8947a5fcdcdd013b99177f64d4416846614c9bcc9a5a63806785aa6"} Jun 14 20:18:14.627197 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.627157 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5nfr" event={"ID":"3163ba5a-f1ea-40e2-9534-af0a66adf0b5","Type":"ContainerStarted","Data":"06091add866226a3b99a0591c9bf495e521b23e2be74919009631b99d88c1a81"} Jun 14 20:18:14.628203 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.628176 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" event={"ID":"a955861c-16a3-424c-95cf-aa772aad27c3","Type":"ContainerStarted","Data":"e94f21a5a4f0d8c117e49d29a89324d57d000c7fd140a049313b7a4220b721da"} Jun 14 20:18:14.629224 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.629198 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5jkg" event={"ID":"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6","Type":"ContainerStarted","Data":"b74c5597d3a8805f0ee598ace52f3a69f985e07ceb975b4be544960c0d945503"} Jun 14 20:18:14.630131 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.630106 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwq64" event={"ID":"3316c4e5-2257-4221-af64-fbbf79dc69b2","Type":"ContainerStarted","Data":"1d3a12648e2b7ef85fa332ee4e29bf52be8b646e435d3358cbde85f263e9f0db"} Jun 14 20:18:14.631066 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.631030 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerStarted","Data":"ff58870b2e31e6db9d16de1fccffcef28f65b77c86fdb8e2c8968b08363acc96"} Jun 14 20:18:14.632593 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.632569 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qcwf4" event={"ID":"aa01d48d-795e-410a-bf18-c059910f998f","Type":"ContainerStarted","Data":"39bcc2cb4fcac1f30a41781163ec330b10d8f1ff0ec3a778d0e270e740602461"} Jun 14 20:18:14.634144 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.634075 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-phwh7" event={"ID":"5a3f0d10-e063-4d46-8b37-56b372453e3f","Type":"ContainerStarted","Data":"3bdcc85262aeec505699bfeeb8ae267f272b64e700a08360471e7d9dc48b089b"} Jun 14 20:18:14.636067 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:14.636047 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal" event={"ID":"0e303832cd2012a08bddfe235a4cca33","Type":"ContainerStarted","Data":"f03014c391e1493229de9c41651d8148aa6573572ab57cecff0b2d3211463a86"} Jun 14 20:18:15.175166 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:15.175132 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:15.175356 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:15.175285 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:15.175356 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:15.175352 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs podName:7c228186-a35c-4a42-8470-6eba1873b428 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:17.175335252 +0000 UTC m=+5.959811836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs") pod "network-metrics-daemon-khjh8" (UID: "7c228186-a35c-4a42-8470-6eba1873b428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:15.276479 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:15.275921 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:15.276479 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:15.276090 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:15.276479 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:15.276145 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret podName:1e0406b2-ebe5-4cb4-8b2a-2bd53a184704 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:17.276127918 +0000 UTC m=+6.060604501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret") pod "global-pull-secret-syncer-fjz5r" (UID: "1e0406b2-ebe5-4cb4-8b2a-2bd53a184704") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:15.377546 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:15.376930 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:15.377546 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:15.377134 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:15.377546 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:15.377155 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:15.377546 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:15.377168 2549 projected.go:196] Error preparing data for projected volume kube-api-access-8k2gt for pod openshift-network-diagnostics/network-check-target-rx2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:15.377546 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:15.377220 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt podName:5abbc5fc-7987-449a-93c9-ade9e2cc16c7 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:17.377203508 +0000 UTC m=+6.161680092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8k2gt" (UniqueName: "kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt") pod "network-check-target-rx2gw" (UID: "5abbc5fc-7987-449a-93c9-ade9e2cc16c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:15.614446 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:15.614415 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:15.614934 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:15.614541 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:15.647483 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:15.647451 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" event={"ID":"db22b5783a611500b92a31fe328e36fa","Type":"ContainerStarted","Data":"cf1bb24d55971e9b44b4135331e67147620cc38219ccf3713c30a7a9a5d3da66"} Jun 14 20:18:15.662452 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:15.661965 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-94.ec2.internal" podStartSLOduration=3.661945222 podStartE2EDuration="3.661945222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:14.668089997 +0000 UTC m=+3.452566590" watchObservedRunningTime="2026-06-14 20:18:15.661945222 +0000 UTC m=+4.446421817" Jun 14 20:18:15.662452 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:15.662208 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-94.ec2.internal" podStartSLOduration=3.66219873 podStartE2EDuration="3.66219873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:15.661106755 +0000 UTC m=+4.445583346" watchObservedRunningTime="2026-06-14 20:18:15.66219873 +0000 UTC m=+4.446675324" Jun 14 20:18:16.613862 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:16.613831 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:16.614058 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:16.613959 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:16.614359 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:16.614340 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:16.614471 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:16.614445 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:17.192825 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:17.192324 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:17.192825 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:17.192472 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:17.192825 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:17.192531 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs podName:7c228186-a35c-4a42-8470-6eba1873b428 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:21.192513412 +0000 UTC m=+9.976989999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs") pod "network-metrics-daemon-khjh8" (UID: "7c228186-a35c-4a42-8470-6eba1873b428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:17.294258 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:17.293727 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:17.294258 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:17.293877 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:17.294258 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:17.293941 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret podName:1e0406b2-ebe5-4cb4-8b2a-2bd53a184704 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:21.293922852 +0000 UTC m=+10.078399426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret") pod "global-pull-secret-syncer-fjz5r" (UID: "1e0406b2-ebe5-4cb4-8b2a-2bd53a184704") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:17.395031 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:17.394997 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:17.395245 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:17.395178 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:17.395245 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:17.395196 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:17.395245 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:17.395207 2549 projected.go:196] Error preparing data for projected volume kube-api-access-8k2gt for pod openshift-network-diagnostics/network-check-target-rx2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:17.395440 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:17.395277 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt podName:5abbc5fc-7987-449a-93c9-ade9e2cc16c7 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:21.395259354 +0000 UTC m=+10.179735941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8k2gt" (UniqueName: "kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt") pod "network-check-target-rx2gw" (UID: "5abbc5fc-7987-449a-93c9-ade9e2cc16c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:17.613783 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:17.613754 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:17.613974 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:17.613902 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:18.613410 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:18.613372 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:18.613890 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:18.613512 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:18.613965 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:18.613908 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:18.614032 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:18.614010 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:19.613709 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:19.613673 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:19.614176 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:19.613840 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:20.615033 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:20.614019 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:20.615033 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:20.614043 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:20.615033 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:20.614159 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:20.615033 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:20.614599 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:21.229623 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:21.229145 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:21.229623 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:21.229293 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:21.229623 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:21.229358 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs podName:7c228186-a35c-4a42-8470-6eba1873b428 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:29.229338505 +0000 UTC m=+18.013815080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs") pod "network-metrics-daemon-khjh8" (UID: "7c228186-a35c-4a42-8470-6eba1873b428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:21.330306 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:21.330270 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:21.330486 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:21.330446 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:21.330548 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:21.330506 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret podName:1e0406b2-ebe5-4cb4-8b2a-2bd53a184704 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:29.330489036 +0000 UTC m=+18.114965608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret") pod "global-pull-secret-syncer-fjz5r" (UID: "1e0406b2-ebe5-4cb4-8b2a-2bd53a184704") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:21.430944 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:21.430911 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:21.431215 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:21.431102 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:21.431215 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:21.431129 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:21.431215 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:21.431142 2549 projected.go:196] Error preparing data for projected volume kube-api-access-8k2gt for pod openshift-network-diagnostics/network-check-target-rx2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:21.431215 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:21.431212 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt podName:5abbc5fc-7987-449a-93c9-ade9e2cc16c7 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:29.43119236 +0000 UTC m=+18.215668934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8k2gt" (UniqueName: "kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt") pod "network-check-target-rx2gw" (UID: "5abbc5fc-7987-449a-93c9-ade9e2cc16c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:21.614149 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:21.614072 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:21.614321 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:21.614185 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:22.614070 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:22.613986 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:22.614507 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:22.614131 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:22.614507 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:22.614473 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:22.614629 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:22.614598 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:23.613634 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:23.613416 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:23.613634 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:23.613552 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:24.613862 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:24.613638 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:24.614331 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:24.613734 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:24.614331 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:24.613993 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:24.614331 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:24.614040 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:25.613767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:25.613730 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:25.613955 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:25.613888 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:26.614123 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:26.614089 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:26.614543 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:26.614226 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:26.614543 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:26.614270 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:26.614543 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:26.614344 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:27.613471 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:27.613435 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:27.613613 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:27.613568 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:28.613614 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:28.613583 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:28.614051 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:28.613717 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:28.614051 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:28.613772 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:28.614051 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:28.613852 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:29.290852 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:29.290818 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:29.291001 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:29.290974 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:29.291048 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:29.291037 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs podName:7c228186-a35c-4a42-8470-6eba1873b428 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:45.291022328 +0000 UTC m=+34.075498902 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs") pod "network-metrics-daemon-khjh8" (UID: "7c228186-a35c-4a42-8470-6eba1873b428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:29.391711 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:29.391675 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:29.391895 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:29.391816 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:29.391895 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:29.391883 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret podName:1e0406b2-ebe5-4cb4-8b2a-2bd53a184704 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:45.391863651 +0000 UTC m=+34.176340232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret") pod "global-pull-secret-syncer-fjz5r" (UID: "1e0406b2-ebe5-4cb4-8b2a-2bd53a184704") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:29.492222 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:29.492194 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:29.492362 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:29.492320 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:29.492362 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:29.492341 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:29.492362 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:29.492353 2549 projected.go:196] Error preparing data for projected volume kube-api-access-8k2gt for pod openshift-network-diagnostics/network-check-target-rx2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:29.492519 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:29.492401 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt podName:5abbc5fc-7987-449a-93c9-ade9e2cc16c7 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:45.492386869 +0000 UTC m=+34.276863437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8k2gt" (UniqueName: "kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt") pod "network-check-target-rx2gw" (UID: "5abbc5fc-7987-449a-93c9-ade9e2cc16c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:29.613852 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:29.613777 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:29.614209 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:29.613916 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:30.613214 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:30.613173 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:30.613438 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:30.613297 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:30.613438 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:30.613364 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:30.613564 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:30.613512 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:31.614271 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:31.614237 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:31.614684 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:31.614330 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:32.613023 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:32.612992 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:32.613171 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:32.613086 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:32.613171 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:32.613147 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:32.613247 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:32.613230 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:33.613678 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.613491 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:33.614332 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:33.613756 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:33.693965 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.693879 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:18:33.694268 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.694247 2549 generic.go:356] "Generic (PLEG): container finished" podID="e825813b-b013-4787-bd50-3d0079d10a17" containerID="f382a824235d134069c64233bbf4bf9ab8928b4380473cd09c47c6f609961706" exitCode=1 Jun 14 20:18:33.694365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.694324 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerStarted","Data":"9999fb9d04abfb9e66ae5f32d15d4612d0ab1f35b1ca9d38b76de3b201852132"} Jun 14 20:18:33.694440 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.694420 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerStarted","Data":"c90efa1b236768104e563139486f8d37a946fea14baebb3e3566669188bdc749"} Jun 14 20:18:33.694572 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.694477 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerStarted","Data":"0433a7a09ee6e607f53d00c35408b95685d0aa03a737bd26d3d2b01cfe9b01bf"} Jun 14 20:18:33.694572 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.694524 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerStarted","Data":"6305535c73e1df9c8b008cbc33edac706401dc639a2079728fe483fc831976f8"} Jun 14 20:18:33.694653 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.694574 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerDied","Data":"f382a824235d134069c64233bbf4bf9ab8928b4380473cd09c47c6f609961706"} Jun 14 20:18:33.694653 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.694624 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerStarted","Data":"f6b89c7243dd0090c164a32d2232d7a7c9306162727f0712e057a7a2ca8a8852"} Jun 14 20:18:33.696277 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.696248 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qcwf4" event={"ID":"aa01d48d-795e-410a-bf18-c059910f998f","Type":"ContainerStarted","Data":"44dd4162f486607b5524f179ba816a4ea3c6251098d29935c5bbccecf2cd8bd2"} Jun 14 20:18:33.698842 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.698492 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-phwh7" event={"ID":"5a3f0d10-e063-4d46-8b37-56b372453e3f","Type":"ContainerStarted","Data":"dd9ecaa76fbe73c651b90e260fe0b4c7a55eee743ab9d690585cff7da4c76763"} Jun 14 20:18:33.701431 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.701409 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" event={"ID":"1ba15824-78cc-4d04-b901-a78ecc98bf99","Type":"ContainerStarted","Data":"492cd4c32dde5f124fb377356abe51238f8b88d857c7251f91db9ff29a94283a"} Jun 14 20:18:33.703029 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.703004 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r8zm6" event={"ID":"6790b23e-adb1-4356-ba9d-6ddb3b1208d2","Type":"ContainerStarted","Data":"96b67a66735d0e8eb863083b84be595f7ba3c8c0eedca64876a734fd90cab124"} Jun 14 20:18:33.704553 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.704531 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" event={"ID":"a955861c-16a3-424c-95cf-aa772aad27c3","Type":"ContainerStarted","Data":"2c74c43e56e374b9cdbf31ecb4a17290d351147537ec07b855b888e949d26360"} Jun 14 20:18:33.706562 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.706214 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5jkg" event={"ID":"25d26a18-3ece-43ad-9dcf-6d29b9ac79f6","Type":"ContainerStarted","Data":"f93e76bbf0399d40df9e23abbbdee62e7c755ae57b5e1aeb6903bd2040d32da4"} Jun 14 20:18:33.708063 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.708041 2549 generic.go:356] "Generic (PLEG): container finished" podID="3316c4e5-2257-4221-af64-fbbf79dc69b2" containerID="46213c0495000f2847678514dfbb2644adbfe2cc2c902622f961f99699b8edfd" exitCode=0 Jun 14 20:18:33.708160 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.708086 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwq64" event={"ID":"3316c4e5-2257-4221-af64-fbbf79dc69b2","Type":"ContainerDied","Data":"46213c0495000f2847678514dfbb2644adbfe2cc2c902622f961f99699b8edfd"} Jun 14 20:18:33.713482 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.713427 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qcwf4" podStartSLOduration=4.212343371 podStartE2EDuration="22.713408211s" totalImagesPullingTime="18.50106484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:33.712545452 +0000 UTC m=+22.497022043" watchObservedRunningTime="2026-06-14 20:18:33.713408211 +0000 UTC m=+22.497884804" Jun 14 20:18:33.749348 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.749272 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t5jkg" podStartSLOduration=4.288114 podStartE2EDuration="22.749251922s" totalImagesPullingTime="18.461137922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:33.748300094 +0000 UTC m=+22.532776685" watchObservedRunningTime="2026-06-14 20:18:33.749251922 +0000 UTC m=+22.533728514" Jun 14 20:18:33.781259 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.781211 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8qzn7" podStartSLOduration=4.327926666 podStartE2EDuration="22.781195183s" totalImagesPullingTime="18.453268517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:33.763699518 +0000 UTC m=+22.548176111" watchObservedRunningTime="2026-06-14 20:18:33.781195183 +0000 UTC m=+22.565671773" Jun 14 20:18:33.781426 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.781305 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-phwh7" podStartSLOduration=4.348681348 podStartE2EDuration="22.781300487s" totalImagesPullingTime="18.432619139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:33.780933954 +0000 UTC m=+22.565410557" watchObservedRunningTime="2026-06-14 20:18:33.781300487 +0000 UTC m=+22.565777078" Jun 14 20:18:33.798573 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.798521 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r8zm6" podStartSLOduration=12.618919237 podStartE2EDuration="22.798503776s" totalImagesPullingTime="10.179584539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:33.797888414 +0000 UTC m=+22.582365005" watchObservedRunningTime="2026-06-14 20:18:33.798503776 +0000 UTC m=+22.582980367" Jun 14 20:18:33.929731 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.929686 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:33.930375 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:33.930353 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:34.552043 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.552022 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 20:18:34.609666 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.609543 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T20:18:34.552040214Z","UUID":"d6f378fa-8a00-4d56-ab5a-8386bea3a36f","Handler":null,"Name":"","Endpoint":""} Jun 14 20:18:34.611759 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.611731 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 20:18:34.611917 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.611776 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 20:18:34.614131 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.614107 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:34.614574 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.614111 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:34.614574 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:34.614318 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:34.614694 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:34.614636 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:34.712879 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.712836 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5nfr" event={"ID":"3163ba5a-f1ea-40e2-9534-af0a66adf0b5","Type":"ContainerStarted","Data":"97e1a98260b9bc86babf070b0ff85c5ccd2a0e3ddc3ab9627edba4da0974c5a4"} Jun 14 20:18:34.715084 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.714952 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" event={"ID":"a955861c-16a3-424c-95cf-aa772aad27c3","Type":"ContainerStarted","Data":"ff55c59d72e9166467e652326e7b5259a38f299ba3b800064020456ffaf82229"} Jun 14 20:18:34.715573 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.715553 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:34.716295 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.716277 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r8zm6" Jun 14 20:18:34.726621 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:34.726566 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s5nfr" podStartSLOduration=5.270758357 podStartE2EDuration="23.726552175s" totalImagesPullingTime="18.455793818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:34.726430223 +0000 UTC m=+23.510906814" watchObservedRunningTime="2026-06-14 20:18:34.726552175 +0000 UTC m=+23.511028766" Jun 14 20:18:35.613351 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:35.613322 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:35.613528 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:35.613503 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:36.614030 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:36.613996 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:36.614690 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:36.613996 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:36.614690 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:36.614170 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:36.614690 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:36.614286 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:36.722386 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:36.722349 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" event={"ID":"a955861c-16a3-424c-95cf-aa772aad27c3","Type":"ContainerStarted","Data":"2302f438d3796902a4d5f9baf0f38946f04d176d78affb4e9c17adcb7e447868"} Jun 14 20:18:36.728346 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:36.728320 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:18:36.728720 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:36.728687 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerStarted","Data":"9e3e4a4934b699a6bc1fd8bc8584b998dd3dc319c5e85e1f52ae26d6b32a1a7d"} Jun 14 20:18:36.740299 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:36.740259 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lx79v" podStartSLOduration=4.910719975 podStartE2EDuration="25.740246579s" totalImagesPullingTime="20.829526604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:36.738969467 +0000 UTC m=+25.523446071" watchObservedRunningTime="2026-06-14 20:18:36.740246579 +0000 UTC m=+25.524723170" Jun 14 20:18:37.613937 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:37.613899 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:37.614109 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:37.614017 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:38.613469 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.613278 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:38.613626 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.613306 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:38.613626 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:38.613544 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:38.613737 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:38.613663 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:38.735444 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.735415 2549 generic.go:356] "Generic (PLEG): container finished" podID="3316c4e5-2257-4221-af64-fbbf79dc69b2" containerID="26596453378bae4ef798c27fa4c3f73e52484eb3bdcfa86eec63965cd2086e29" exitCode=0 Jun 14 20:18:38.735952 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.735501 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwq64" event={"ID":"3316c4e5-2257-4221-af64-fbbf79dc69b2","Type":"ContainerDied","Data":"26596453378bae4ef798c27fa4c3f73e52484eb3bdcfa86eec63965cd2086e29"} Jun 14 20:18:38.739129 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.739112 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:18:38.739474 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.739455 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerStarted","Data":"4d1a5bcd0372509e9f0a0b3bfaa41ad45b782e86b10aafbd75855e2430d42ef4"} Jun 14 20:18:38.739761 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.739741 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:38.739866 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.739834 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:38.739936 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.739921 2549 scope.go:117] "RemoveContainer" containerID="f382a824235d134069c64233bbf4bf9ab8928b4380473cd09c47c6f609961706" Jun 14 20:18:38.755948 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:38.755927 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:39.613163 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:39.613127 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:39.613318 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:39.613269 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:39.743748 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:39.743705 2549 generic.go:356] "Generic (PLEG): container finished" podID="3316c4e5-2257-4221-af64-fbbf79dc69b2" containerID="14d4db166531b975029e8529e5107078a2119dd930c114ce131ac7358338fac9" exitCode=0 Jun 14 20:18:39.744203 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:39.743787 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwq64" event={"ID":"3316c4e5-2257-4221-af64-fbbf79dc69b2","Type":"ContainerDied","Data":"14d4db166531b975029e8529e5107078a2119dd930c114ce131ac7358338fac9"} Jun 14 20:18:39.747820 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:39.747785 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:18:39.748193 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:39.748157 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" event={"ID":"e825813b-b013-4787-bd50-3d0079d10a17","Type":"ContainerStarted","Data":"74482766d0da77bd199fc01380fd777cd70509f717e96233d4e9e00ad846b53f"} Jun 14 20:18:39.748365 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:39.748346 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:39.762448 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:39.762424 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:18:39.793691 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:39.793652 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" podStartSLOduration=10.316384526 podStartE2EDuration="28.793640273s" totalImagesPullingTime="18.477255747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:39.793433512 +0000 UTC m=+28.577910104" watchObservedRunningTime="2026-06-14 20:18:39.793640273 +0000 UTC m=+28.578116864" Jun 14 20:18:40.613169 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.613003 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:40.613271 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.613062 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:40.613271 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:40.613204 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:40.613341 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:40.613285 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:40.649380 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.649351 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-khjh8"] Jun 14 20:18:40.649986 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.649960 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjz5r"] Jun 14 20:18:40.650105 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.650041 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:40.650185 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:40.650134 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:40.650644 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.650624 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rx2gw"] Jun 14 20:18:40.752586 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.752563 2549 generic.go:356] "Generic (PLEG): container finished" podID="3316c4e5-2257-4221-af64-fbbf79dc69b2" containerID="a70a4661f1b1c3d57d561cea56108a15fd2d0553ec37377fa2b9d8c513fbedba" exitCode=0 Jun 14 20:18:40.753197 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.752646 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwq64" event={"ID":"3316c4e5-2257-4221-af64-fbbf79dc69b2","Type":"ContainerDied","Data":"a70a4661f1b1c3d57d561cea56108a15fd2d0553ec37377fa2b9d8c513fbedba"} Jun 14 20:18:40.753197 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.752792 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:40.753197 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:40.753135 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:40.753197 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:40.753152 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:40.753505 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:40.753229 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:42.613920 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:42.613890 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:42.614483 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:42.613891 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:42.614483 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:42.614016 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:42.614483 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:42.614023 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:42.614483 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:42.614106 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:42.614483 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:42.614204 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:44.613939 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:44.613906 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:44.613939 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:44.613947 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:44.614424 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:44.614034 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:44.614424 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:44.614029 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjz5r" podUID="1e0406b2-ebe5-4cb4-8b2a-2bd53a184704" Jun 14 20:18:44.614424 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:44.614131 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:18:44.614424 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:44.614237 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx2gw" podUID="5abbc5fc-7987-449a-93c9-ade9e2cc16c7" Jun 14 20:18:45.315868 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:45.315780 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:45.316151 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:45.315919 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:45.316151 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:45.315986 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs podName:7c228186-a35c-4a42-8470-6eba1873b428 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:17.315967387 +0000 UTC m=+66.100443972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs") pod "network-metrics-daemon-khjh8" (UID: "7c228186-a35c-4a42-8470-6eba1873b428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:45.417048 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:45.417019 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:45.417207 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:45.417150 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:45.417269 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:45.417221 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret podName:1e0406b2-ebe5-4cb4-8b2a-2bd53a184704 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:17.417200868 +0000 UTC m=+66.201677452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret") pod "global-pull-secret-syncer-fjz5r" (UID: "1e0406b2-ebe5-4cb4-8b2a-2bd53a184704") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:45.518368 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:45.518159 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:45.518510 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:45.518347 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:45.518510 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:45.518469 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:45.518510 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:45.518484 2549 projected.go:196] Error preparing data for projected volume kube-api-access-8k2gt for pod openshift-network-diagnostics/network-check-target-rx2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:45.518669 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:45.518555 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt podName:5abbc5fc-7987-449a-93c9-ade9e2cc16c7 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:17.5185413 +0000 UTC m=+66.303017877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8k2gt" (UniqueName: "kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt") pod "network-check-target-rx2gw" (UID: "5abbc5fc-7987-449a-93c9-ade9e2cc16c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:46.054975 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.054945 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-94.ec2.internal" event="NodeReady" Jun 14 20:18:46.055344 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.055078 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 20:18:46.095978 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.095946 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-whcdl"] Jun 14 20:18:46.116517 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.116480 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lfmgm"] Jun 14 20:18:46.116660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.116609 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.118946 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.118921 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 20:18:46.119088 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.118925 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qhwh9\"" Jun 14 20:18:46.119088 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.119063 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 20:18:46.130593 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.130571 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whcdl"] Jun 14 20:18:46.130697 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.130607 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lfmgm"] Jun 14 20:18:46.130697 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.130675 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lfmgm" Jun 14 20:18:46.133470 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.133449 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 20:18:46.133578 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.133473 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 20:18:46.133578 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.133454 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l9p5z\"" Jun 14 20:18:46.133578 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.133505 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 20:18:46.223544 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.223511 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf5gk\" (UniqueName: \"kubernetes.io/projected/798a36ad-73f8-4038-8fd7-88530c89f53a-kube-api-access-mf5gk\") pod \"ingress-canary-lfmgm\" (UID: \"798a36ad-73f8-4038-8fd7-88530c89f53a\") " pod="openshift-ingress-canary/ingress-canary-lfmgm" Jun 14 20:18:46.223544 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.223544 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-tmp-dir\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.223821 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.223661 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/798a36ad-73f8-4038-8fd7-88530c89f53a-cert\") pod \"ingress-canary-lfmgm\" (UID: \"798a36ad-73f8-4038-8fd7-88530c89f53a\") " pod="openshift-ingress-canary/ingress-canary-lfmgm" Jun 14 20:18:46.223821 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.223696 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.223821 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.223730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq7kj\" (UniqueName: \"kubernetes.io/projected/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-kube-api-access-mq7kj\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.223821 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.223761 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-config-volume\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.324944 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.324859 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq7kj\" (UniqueName: \"kubernetes.io/projected/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-kube-api-access-mq7kj\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.324944 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.324898 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-config-volume\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.325147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.324947 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf5gk\" (UniqueName: \"kubernetes.io/projected/798a36ad-73f8-4038-8fd7-88530c89f53a-kube-api-access-mf5gk\") pod \"ingress-canary-lfmgm\" (UID: \"798a36ad-73f8-4038-8fd7-88530c89f53a\") " pod="openshift-ingress-canary/ingress-canary-lfmgm" Jun 14 20:18:46.325147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.324976 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-tmp-dir\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.325147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.325044 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/798a36ad-73f8-4038-8fd7-88530c89f53a-cert\") pod \"ingress-canary-lfmgm\" (UID: \"798a36ad-73f8-4038-8fd7-88530c89f53a\") " pod="openshift-ingress-canary/ingress-canary-lfmgm" Jun 14 20:18:46.325147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.325064 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.325294 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:46.325258 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:46.325333 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:46.325325 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls podName:1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:46.825303222 +0000 UTC m=+35.609779791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls") pod "dns-default-whcdl" (UID: "1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313") : secret "dns-default-metrics-tls" not found Jun 14 20:18:46.325412 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.325387 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-tmp-dir\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.325634 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.325609 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-config-volume\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.329122 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.329103 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/798a36ad-73f8-4038-8fd7-88530c89f53a-cert\") pod \"ingress-canary-lfmgm\" (UID: \"798a36ad-73f8-4038-8fd7-88530c89f53a\") " pod="openshift-ingress-canary/ingress-canary-lfmgm" Jun 14 20:18:46.333313 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.333286 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq7kj\" (UniqueName: \"kubernetes.io/projected/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-kube-api-access-mq7kj\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.333461 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.333440 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf5gk\" (UniqueName: \"kubernetes.io/projected/798a36ad-73f8-4038-8fd7-88530c89f53a-kube-api-access-mf5gk\") pod \"ingress-canary-lfmgm\" (UID: \"798a36ad-73f8-4038-8fd7-88530c89f53a\") " pod="openshift-ingress-canary/ingress-canary-lfmgm" Jun 14 20:18:46.439064 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.439033 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lfmgm" Jun 14 20:18:46.613377 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.613350 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:18:46.613514 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.613388 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:18:46.613514 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.613481 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:18:46.617660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.616985 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d5gdc\"" Jun 14 20:18:46.617660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.617006 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 20:18:46.617660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.617245 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 20:18:46.617660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.617275 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 20:18:46.617660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.617543 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 20:18:46.618042 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.617941 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7cfxq\"" Jun 14 20:18:46.665556 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.665530 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lfmgm"] Jun 14 20:18:46.669312 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:18:46.669276 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798a36ad_73f8_4038_8fd7_88530c89f53a.slice/crio-d612380effc47d06944a4ffff2729207dbefd3fadfbb25a02c3bcbe13acf9684 WatchSource:0}: Error finding container d612380effc47d06944a4ffff2729207dbefd3fadfbb25a02c3bcbe13acf9684: Status 404 returned error can't find the container with id d612380effc47d06944a4ffff2729207dbefd3fadfbb25a02c3bcbe13acf9684 Jun 14 20:18:46.769925 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.769881 2549 generic.go:356] "Generic (PLEG): container finished" podID="3316c4e5-2257-4221-af64-fbbf79dc69b2" containerID="7ebd0237d53d4dadad0a5303af17d7cc5421bf1063b161dbfbbffa06855dad99" exitCode=0 Jun 14 20:18:46.770107 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.769966 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwq64" event={"ID":"3316c4e5-2257-4221-af64-fbbf79dc69b2","Type":"ContainerDied","Data":"7ebd0237d53d4dadad0a5303af17d7cc5421bf1063b161dbfbbffa06855dad99"} Jun 14 20:18:46.771094 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.771070 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lfmgm" event={"ID":"798a36ad-73f8-4038-8fd7-88530c89f53a","Type":"ContainerStarted","Data":"d612380effc47d06944a4ffff2729207dbefd3fadfbb25a02c3bcbe13acf9684"} Jun 14 20:18:46.827701 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:46.827669 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:46.827884 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:46.827865 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:46.827956 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:46.827929 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls podName:1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:47.827914317 +0000 UTC m=+36.612390887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls") pod "dns-default-whcdl" (UID: "1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313") : secret "dns-default-metrics-tls" not found Jun 14 20:18:47.777689 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:47.777471 2549 generic.go:356] "Generic (PLEG): container finished" podID="3316c4e5-2257-4221-af64-fbbf79dc69b2" containerID="55d5eb76c941e7a20722e5e8c4e06ff85086eccb1543590af17e08a46722ae6c" exitCode=0 Jun 14 20:18:47.778100 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:47.777524 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwq64" event={"ID":"3316c4e5-2257-4221-af64-fbbf79dc69b2","Type":"ContainerDied","Data":"55d5eb76c941e7a20722e5e8c4e06ff85086eccb1543590af17e08a46722ae6c"} Jun 14 20:18:47.835877 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:47.835843 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:47.836064 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:47.836017 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:47.836109 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:47.836086 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls podName:1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:49.836069929 +0000 UTC m=+38.620546510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls") pod "dns-default-whcdl" (UID: "1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313") : secret "dns-default-metrics-tls" not found Jun 14 20:18:48.781920 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:48.781822 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lfmgm" event={"ID":"798a36ad-73f8-4038-8fd7-88530c89f53a","Type":"ContainerStarted","Data":"d07937a8510de627d415bc76670ee95bdb0892e370099976f0b4f19005207577"} Jun 14 20:18:48.785581 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:48.785554 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwq64" event={"ID":"3316c4e5-2257-4221-af64-fbbf79dc69b2","Type":"ContainerStarted","Data":"be74f4fc6ecd3712d24bbe3195afed59e872b6ae4fbc5b21470227226ab48a43"} Jun 14 20:18:48.798826 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:48.798766 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lfmgm" podStartSLOduration=0.985633535 podStartE2EDuration="2.798748912s" totalImagesPullingTime="1.813115377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:48.797743389 +0000 UTC m=+37.582219979" watchObservedRunningTime="2026-06-14 20:18:48.798748912 +0000 UTC m=+37.583225519" Jun 14 20:18:48.824015 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:48.823955 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nwq64" podStartSLOduration=7.635470118 podStartE2EDuration="37.823933664s" totalImagesPullingTime="30.188463546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:48.823832529 +0000 UTC m=+37.608309143" watchObservedRunningTime="2026-06-14 20:18:48.823933664 +0000 UTC m=+37.608410258" Jun 14 20:18:49.850010 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:49.849973 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:49.850375 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:49.850094 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:49.850375 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:49.850157 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls podName:1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:53.850144169 +0000 UTC m=+42.634620741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls") pod "dns-default-whcdl" (UID: "1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313") : secret "dns-default-metrics-tls" not found Jun 14 20:18:53.880690 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:18:53.880664 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:18:53.881116 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:53.880763 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:53.881116 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:18:53.880831 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls podName:1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:01.880815173 +0000 UTC m=+50.665291772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls") pod "dns-default-whcdl" (UID: "1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313") : secret "dns-default-metrics-tls" not found Jun 14 20:19:01.932280 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:01.932248 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:19:01.932709 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:19:01.932367 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:19:01.932709 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:19:01.932427 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls podName:1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:17.932411271 +0000 UTC m=+66.716887859 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls") pod "dns-default-whcdl" (UID: "1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313") : secret "dns-default-metrics-tls" not found Jun 14 20:19:11.765329 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:11.765304 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwm4z" Jun 14 20:19:17.335437 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.335394 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:19:17.338548 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.338522 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 20:19:17.345852 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:19:17.345833 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 20:19:17.345967 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:19:17.345908 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs podName:7c228186-a35c-4a42-8470-6eba1873b428 nodeName:}" failed. No retries permitted until 2026-06-14 20:20:21.345886943 +0000 UTC m=+130.130363540 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs") pod "network-metrics-daemon-khjh8" (UID: "7c228186-a35c-4a42-8470-6eba1873b428") : secret "metrics-daemon-secret" not found Jun 14 20:19:17.436172 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.436129 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:19:17.438709 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.438689 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 20:19:17.449910 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.449876 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e0406b2-ebe5-4cb4-8b2a-2bd53a184704-original-pull-secret\") pod \"global-pull-secret-syncer-fjz5r\" (UID: \"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704\") " pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:19:17.527636 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.527604 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjz5r" Jun 14 20:19:17.537045 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.537018 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:19:17.539584 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.539567 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 20:19:17.551445 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.551422 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 20:19:17.560858 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.560830 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k2gt\" (UniqueName: \"kubernetes.io/projected/5abbc5fc-7987-449a-93c9-ade9e2cc16c7-kube-api-access-8k2gt\") pod \"network-check-target-rx2gw\" (UID: \"5abbc5fc-7987-449a-93c9-ade9e2cc16c7\") " pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:19:17.692614 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.692580 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjz5r"] Jun 14 20:19:17.696116 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:19:17.696074 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0406b2_ebe5_4cb4_8b2a_2bd53a184704.slice/crio-341ab886318ccaaf471b68c9f74729f1560401aac6ccbf3314a3cc688bb68a10 WatchSource:0}: Error finding container 341ab886318ccaaf471b68c9f74729f1560401aac6ccbf3314a3cc688bb68a10: Status 404 returned error can't find the container with id 341ab886318ccaaf471b68c9f74729f1560401aac6ccbf3314a3cc688bb68a10 Jun 14 20:19:17.847229 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.847198 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d5gdc\"" Jun 14 20:19:17.851014 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.850984 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjz5r" event={"ID":"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704","Type":"ContainerStarted","Data":"341ab886318ccaaf471b68c9f74729f1560401aac6ccbf3314a3cc688bb68a10"} Jun 14 20:19:17.855144 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.855130 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:19:17.940994 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.940964 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:19:17.941183 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:19:17.941139 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:19:17.941254 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:19:17.941206 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls podName:1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:49.941188429 +0000 UTC m=+98.725665019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls") pod "dns-default-whcdl" (UID: "1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313") : secret "dns-default-metrics-tls" not found Jun 14 20:19:17.994880 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:17.994850 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rx2gw"] Jun 14 20:19:17.998882 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:19:17.998854 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abbc5fc_7987_449a_93c9_ade9e2cc16c7.slice/crio-f37d75fabf4dac92d000b95e8c8e87c8f6c998a902fcd4118bf51e6841a69f41 WatchSource:0}: Error finding container f37d75fabf4dac92d000b95e8c8e87c8f6c998a902fcd4118bf51e6841a69f41: Status 404 returned error can't find the container with id f37d75fabf4dac92d000b95e8c8e87c8f6c998a902fcd4118bf51e6841a69f41 Jun 14 20:19:18.856336 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:18.856300 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rx2gw" event={"ID":"5abbc5fc-7987-449a-93c9-ade9e2cc16c7","Type":"ContainerStarted","Data":"f37d75fabf4dac92d000b95e8c8e87c8f6c998a902fcd4118bf51e6841a69f41"} Jun 14 20:19:22.869453 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:22.869409 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjz5r" event={"ID":"1e0406b2-ebe5-4cb4-8b2a-2bd53a184704","Type":"ContainerStarted","Data":"5139b5513bcce65b7b444a7a82bc85395723e6e8c9db8a80d2be9a450c46104f"} Jun 14 20:19:22.870950 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:22.870924 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rx2gw" event={"ID":"5abbc5fc-7987-449a-93c9-ade9e2cc16c7","Type":"ContainerStarted","Data":"c975f0503966305bc3d64c7aea40f8252cfdd2446bb71c24765ba6505c0d1725"} Jun 14 20:19:22.871070 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:22.870990 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:19:22.885339 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:22.885293 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fjz5r" podStartSLOduration=67.150762566 podStartE2EDuration="1m11.885279828s" totalImagesPullingTime="4.734517262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:19:22.884860397 +0000 UTC m=+71.669337008" watchObservedRunningTime="2026-06-14 20:19:22.885279828 +0000 UTC m=+71.669756397" Jun 14 20:19:22.899303 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:22.899262 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rx2gw" podStartSLOduration=67.469590096 podStartE2EDuration="1m11.899249991s" totalImagesPullingTime="4.429659895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:19:22.898867382 +0000 UTC m=+71.683343985" watchObservedRunningTime="2026-06-14 20:19:22.899249991 +0000 UTC m=+71.683726581" Jun 14 20:19:26.970121 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.970089 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99"] Jun 14 20:19:26.972646 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.972624 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:26.975126 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.975106 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 20:19:26.975317 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.975298 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 14 20:19:26.975382 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.975335 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 14 20:19:26.975382 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.975349 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 20:19:26.975502 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.975386 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 20:19:26.976374 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.976349 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 14 20:19:26.976374 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.976364 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 14 20:19:26.985995 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.985973 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99"] Jun 14 20:19:26.999775 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.999744 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:26.999775 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.999777 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnp78\" (UniqueName: \"kubernetes.io/projected/7db0a423-8818-4234-966b-07860c2dfafb-kube-api-access-wnp78\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:26.999956 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.999815 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:26.999956 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.999895 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7db0a423-8818-4234-966b-07860c2dfafb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:26.999956 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.999921 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-hub\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:26.999956 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:26.999938 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-ca\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.100380 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.100344 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.100380 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.100384 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnp78\" (UniqueName: \"kubernetes.io/projected/7db0a423-8818-4234-966b-07860c2dfafb-kube-api-access-wnp78\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.100634 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.100401 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.100634 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.100452 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7db0a423-8818-4234-966b-07860c2dfafb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.100634 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.100470 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-hub\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.100634 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.100485 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-ca\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.101333 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.101303 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7db0a423-8818-4234-966b-07860c2dfafb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.103070 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.103039 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-ca\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.103215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.103123 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.103215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.103156 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-hub\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.103307 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.103239 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7db0a423-8818-4234-966b-07860c2dfafb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.110042 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.110022 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnp78\" (UniqueName: \"kubernetes.io/projected/7db0a423-8818-4234-966b-07860c2dfafb-kube-api-access-wnp78\") pod \"cluster-proxy-proxy-agent-dcb7cd958-b7q99\" (UID: \"7db0a423-8818-4234-966b-07860c2dfafb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.293644 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.293544 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:19:27.413296 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.413267 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99"] Jun 14 20:19:27.416174 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:19:27.416146 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7db0a423_8818_4234_966b_07860c2dfafb.slice/crio-1395df3673d7a37caa504b407f596da89d691abf5f09b8b169b8031288db613c WatchSource:0}: Error finding container 1395df3673d7a37caa504b407f596da89d691abf5f09b8b169b8031288db613c: Status 404 returned error can't find the container with id 1395df3673d7a37caa504b407f596da89d691abf5f09b8b169b8031288db613c Jun 14 20:19:27.884486 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:27.884451 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" event={"ID":"7db0a423-8818-4234-966b-07860c2dfafb","Type":"ContainerStarted","Data":"1395df3673d7a37caa504b407f596da89d691abf5f09b8b169b8031288db613c"} Jun 14 20:19:31.898197 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:31.898159 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" event={"ID":"7db0a423-8818-4234-966b-07860c2dfafb","Type":"ContainerStarted","Data":"dc6e5805c09ad43c829632400ef1575e44df63b7713f0e07b0f782a1c05a6020"} Jun 14 20:19:31.898587 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:31.898209 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" event={"ID":"7db0a423-8818-4234-966b-07860c2dfafb","Type":"ContainerStarted","Data":"c81a2c265c401767d5073c2776fe2a8eba0e37e11ac814725455116bf8f9f94c"} Jun 14 20:19:31.898587 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:31.898227 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" event={"ID":"7db0a423-8818-4234-966b-07860c2dfafb","Type":"ContainerStarted","Data":"3597a47070db602d64a875eb8d06f3854b407d2c148887226718bdd5f2b767e6"} Jun 14 20:19:31.915618 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:31.915569 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" podStartSLOduration=2.416896866 podStartE2EDuration="5.915552791s" totalImagesPullingTime="3.498655925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:19:31.914284696 +0000 UTC m=+80.698761287" watchObservedRunningTime="2026-06-14 20:19:31.915552791 +0000 UTC m=+80.700029382" Jun 14 20:19:49.946339 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:49.946306 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:19:49.946764 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:19:49.946409 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:19:49.946764 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:19:49.946467 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls podName:1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313 nodeName:}" failed. No retries permitted until 2026-06-14 20:20:53.946454198 +0000 UTC m=+162.730930768 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls") pod "dns-default-whcdl" (UID: "1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313") : secret "dns-default-metrics-tls" not found Jun 14 20:19:53.875391 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:19:53.875356 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rx2gw" Jun 14 20:20:21.354656 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:20:21.354623 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:20:21.355120 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:20:21.354734 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 20:20:21.355120 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:20:21.354827 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs podName:7c228186-a35c-4a42-8470-6eba1873b428 nodeName:}" failed. No retries permitted until 2026-06-14 20:22:23.354791228 +0000 UTC m=+252.139267816 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs") pod "network-metrics-daemon-khjh8" (UID: "7c228186-a35c-4a42-8470-6eba1873b428") : secret "metrics-daemon-secret" not found Jun 14 20:20:49.125324 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:20:49.125277 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-whcdl" podUID="1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313" Jun 14 20:20:49.636482 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:20:49.636447 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-khjh8" podUID="7c228186-a35c-4a42-8470-6eba1873b428" Jun 14 20:20:50.126790 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:20:50.126765 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whcdl" Jun 14 20:20:53.965907 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:20:53.965874 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:20:53.966278 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:20:53.965987 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:20:53.966278 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:20:53.966046 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls podName:1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313 nodeName:}" failed. No retries permitted until 2026-06-14 20:22:55.96603407 +0000 UTC m=+284.750510639 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls") pod "dns-default-whcdl" (UID: "1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313") : secret "dns-default-metrics-tls" not found Jun 14 20:21:00.614031 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:00.613998 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:21:52.438499 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.438462 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7"] Jun 14 20:21:52.440340 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.440324 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.442706 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.442685 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 14 20:21:52.443267 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.443252 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nf2pd\"" Jun 14 20:21:52.443874 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.443855 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 14 20:21:52.443947 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.443915 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 14 20:21:52.444132 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.444119 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 14 20:21:52.456112 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.456089 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7"] Jun 14 20:21:52.556894 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.556859 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb5lz\" (UniqueName: \"kubernetes.io/projected/eb092e32-b025-412f-b6d3-b26de843e3a4-kube-api-access-lb5lz\") pod \"service-ca-operator-7ccbfd59dc-zgpl7\" (UID: \"eb092e32-b025-412f-b6d3-b26de843e3a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.556894 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.556901 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb092e32-b025-412f-b6d3-b26de843e3a4-config\") pod \"service-ca-operator-7ccbfd59dc-zgpl7\" (UID: \"eb092e32-b025-412f-b6d3-b26de843e3a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.557103 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.556928 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb092e32-b025-412f-b6d3-b26de843e3a4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-zgpl7\" (UID: \"eb092e32-b025-412f-b6d3-b26de843e3a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.657741 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.657702 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb092e32-b025-412f-b6d3-b26de843e3a4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-zgpl7\" (UID: \"eb092e32-b025-412f-b6d3-b26de843e3a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.657940 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.657769 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb5lz\" (UniqueName: \"kubernetes.io/projected/eb092e32-b025-412f-b6d3-b26de843e3a4-kube-api-access-lb5lz\") pod \"service-ca-operator-7ccbfd59dc-zgpl7\" (UID: \"eb092e32-b025-412f-b6d3-b26de843e3a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.657940 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.657922 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb092e32-b025-412f-b6d3-b26de843e3a4-config\") pod \"service-ca-operator-7ccbfd59dc-zgpl7\" (UID: \"eb092e32-b025-412f-b6d3-b26de843e3a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.658437 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.658418 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb092e32-b025-412f-b6d3-b26de843e3a4-config\") pod \"service-ca-operator-7ccbfd59dc-zgpl7\" (UID: \"eb092e32-b025-412f-b6d3-b26de843e3a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.659992 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.659972 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb092e32-b025-412f-b6d3-b26de843e3a4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-zgpl7\" (UID: \"eb092e32-b025-412f-b6d3-b26de843e3a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.665394 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.665371 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb5lz\" (UniqueName: \"kubernetes.io/projected/eb092e32-b025-412f-b6d3-b26de843e3a4-kube-api-access-lb5lz\") pod \"service-ca-operator-7ccbfd59dc-zgpl7\" (UID: \"eb092e32-b025-412f-b6d3-b26de843e3a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.749226 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.749189 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" Jun 14 20:21:52.865952 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:52.865895 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7"] Jun 14 20:21:52.868750 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:21:52.868723 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb092e32_b025_412f_b6d3_b26de843e3a4.slice/crio-043dba40d04cd1f9b825d60d17890888c41b592e02754b24c1b20f23adea68e6 WatchSource:0}: Error finding container 043dba40d04cd1f9b825d60d17890888c41b592e02754b24c1b20f23adea68e6: Status 404 returned error can't find the container with id 043dba40d04cd1f9b825d60d17890888c41b592e02754b24c1b20f23adea68e6 Jun 14 20:21:53.302628 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:53.302597 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" event={"ID":"eb092e32-b025-412f-b6d3-b26de843e3a4","Type":"ContainerStarted","Data":"043dba40d04cd1f9b825d60d17890888c41b592e02754b24c1b20f23adea68e6"} Jun 14 20:21:55.309519 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:55.309479 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" event={"ID":"eb092e32-b025-412f-b6d3-b26de843e3a4","Type":"ContainerStarted","Data":"ee8a5ff8e25b25990772c7baf4e1c98e761b7b3ed703f919b12219bd78f9e96b"} Jun 14 20:21:55.325199 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:55.325111 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" podStartSLOduration=1.067815754 podStartE2EDuration="3.325096197s" totalImagesPullingTime="2.257280443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:21:55.324192629 +0000 UTC m=+224.108669220" watchObservedRunningTime="2026-06-14 20:21:55.325096197 +0000 UTC m=+224.109572767" Jun 14 20:21:55.997130 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:55.997096 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lx4ct"] Jun 14 20:21:55.999212 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:55.999198 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.001505 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.001474 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 20:21:56.001825 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.001488 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 20:21:56.001906 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.001858 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 20:21:56.002648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.002633 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nr27v\"" Jun 14 20:21:56.002767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.002744 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 20:21:56.014117 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.014090 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lx4ct"] Jun 14 20:21:56.083767 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.083728 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.083980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.083837 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ab64754-87a9-4388-b82d-3fd889ec732f-crio-socket\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.083980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.083865 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ab64754-87a9-4388-b82d-3fd889ec732f-data-volume\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.083980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.083881 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.083980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.083896 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptmjt\" (UniqueName: \"kubernetes.io/projected/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-api-access-ptmjt\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.184445 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.184399 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ab64754-87a9-4388-b82d-3fd889ec732f-crio-socket\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.184618 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.184461 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ab64754-87a9-4388-b82d-3fd889ec732f-data-volume\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.184618 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.184514 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.184618 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.184536 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ab64754-87a9-4388-b82d-3fd889ec732f-crio-socket\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.184618 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.184540 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptmjt\" (UniqueName: \"kubernetes.io/projected/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-api-access-ptmjt\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.184855 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.184621 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.184855 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:56.184726 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:21:56.184855 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:56.184733 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:21:56.184855 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:56.184787 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:21:56.68477142 +0000 UTC m=+225.469247990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : configmap "kube-rbac-proxy" not found Jun 14 20:21:56.184855 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:56.184820 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:21:56.684813939 +0000 UTC m=+225.469290508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : secret "insights-runtime-extractor-tls" not found Jun 14 20:21:56.185092 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.184880 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ab64754-87a9-4388-b82d-3fd889ec732f-data-volume\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.192267 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.192246 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptmjt\" (UniqueName: \"kubernetes.io/projected/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-api-access-ptmjt\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.688567 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.688520 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.688567 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:56.688571 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:56.689026 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:56.688635 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:21:56.689026 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:56.688674 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:21:56.689026 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:56.688713 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:21:57.688682087 +0000 UTC m=+226.473158656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : configmap "kube-rbac-proxy" not found Jun 14 20:21:56.689026 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:56.688728 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:21:57.688721141 +0000 UTC m=+226.473197710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : secret "insights-runtime-extractor-tls" not found Jun 14 20:21:57.696291 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:57.696250 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:57.696732 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:57.696301 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:57.696732 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:57.696368 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:21:57.696732 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:57.696437 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:21:59.696420276 +0000 UTC m=+228.480896844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : configmap "kube-rbac-proxy" not found Jun 14 20:21:57.696732 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:57.696435 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:21:57.696732 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:57.696493 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:21:59.696477513 +0000 UTC m=+228.480954083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : secret "insights-runtime-extractor-tls" not found Jun 14 20:21:58.189341 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:58.189315 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5jkg_25d26a18-3ece-43ad-9dcf-6d29b9ac79f6/dns-node-resolver/0.log" Jun 14 20:21:58.988908 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:58.988881 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-phwh7_5a3f0d10-e063-4d46-8b37-56b372453e3f/node-ca/0.log" Jun 14 20:21:59.711909 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:59.711873 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:59.712085 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:59.711916 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:21:59.712085 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:59.711998 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:21:59.712085 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:59.712024 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:21:59.712085 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:59.712067 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:22:03.712050304 +0000 UTC m=+232.496526876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : secret "insights-runtime-extractor-tls" not found Jun 14 20:21:59.712085 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:21:59.712083 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:22:03.712074585 +0000 UTC m=+232.496551161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : configmap "kube-rbac-proxy" not found Jun 14 20:21:59.789621 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:21:59.789591 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lfmgm_798a36ad-73f8-4038-8fd7-88530c89f53a/serve-healthcheck-canary/0.log" Jun 14 20:22:03.740611 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:03.740560 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:22:03.740611 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:03.740617 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:22:03.741077 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:22:03.740672 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:22:03.741077 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:22:03.740735 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:22:11.740717265 +0000 UTC m=+240.525193838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : configmap "kube-rbac-proxy" not found Jun 14 20:22:03.741077 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:22:03.740735 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:22:03.741077 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:22:03.740763 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:22:11.740757499 +0000 UTC m=+240.525234067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : secret "insights-runtime-extractor-tls" not found Jun 14 20:22:11.805436 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:11.805398 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:22:11.805815 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:11.805544 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:22:11.805815 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:22:11.805548 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:22:11.805815 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:22:11.805605 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls podName:6ab64754-87a9-4388-b82d-3fd889ec732f nodeName:}" failed. No retries permitted until 2026-06-14 20:22:27.805590672 +0000 UTC m=+256.590067241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx4ct" (UID: "6ab64754-87a9-4388-b82d-3fd889ec732f") : secret "insights-runtime-extractor-tls" not found Jun 14 20:22:11.806011 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:11.805995 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab64754-87a9-4388-b82d-3fd889ec732f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:22:17.791415 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.791379 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-696b9bdf5b-rghsb"] Jun 14 20:22:17.793852 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.793835 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:17.796407 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.796382 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 20:22:17.796671 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.796655 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 20:22:17.796746 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.796727 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 20:22:17.797526 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.797506 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dldwt\"" Jun 14 20:22:17.801946 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.801923 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 20:22:17.804679 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.804658 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-696b9bdf5b-rghsb"] Jun 14 20:22:17.953615 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.953584 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/354fe887-8a7e-4769-89d4-45bbecde7427-ca-trust-extracted\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:17.953615 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.953624 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/354fe887-8a7e-4769-89d4-45bbecde7427-trusted-ca\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:17.953872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.953699 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/354fe887-8a7e-4769-89d4-45bbecde7427-image-registry-private-configuration\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:17.953872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.953738 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/354fe887-8a7e-4769-89d4-45bbecde7427-registry-tls\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:17.953872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.953761 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfp4z\" (UniqueName: \"kubernetes.io/projected/354fe887-8a7e-4769-89d4-45bbecde7427-kube-api-access-gfp4z\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:17.953872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.953783 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/354fe887-8a7e-4769-89d4-45bbecde7427-bound-sa-token\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:17.953872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.953835 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/354fe887-8a7e-4769-89d4-45bbecde7427-registry-certificates\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:17.953872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:17.953858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/354fe887-8a7e-4769-89d4-45bbecde7427-installation-pull-secrets\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.054872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.054750 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/354fe887-8a7e-4769-89d4-45bbecde7427-image-registry-private-configuration\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.054872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.054813 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/354fe887-8a7e-4769-89d4-45bbecde7427-registry-tls\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.054872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.054844 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfp4z\" (UniqueName: \"kubernetes.io/projected/354fe887-8a7e-4769-89d4-45bbecde7427-kube-api-access-gfp4z\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.054872 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.054873 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/354fe887-8a7e-4769-89d4-45bbecde7427-bound-sa-token\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.055225 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.054897 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/354fe887-8a7e-4769-89d4-45bbecde7427-registry-certificates\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.055225 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.054924 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/354fe887-8a7e-4769-89d4-45bbecde7427-installation-pull-secrets\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.055225 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.055099 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/354fe887-8a7e-4769-89d4-45bbecde7427-ca-trust-extracted\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.055225 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.055158 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/354fe887-8a7e-4769-89d4-45bbecde7427-trusted-ca\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.055476 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.055453 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/354fe887-8a7e-4769-89d4-45bbecde7427-ca-trust-extracted\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.055853 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.055832 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/354fe887-8a7e-4769-89d4-45bbecde7427-registry-certificates\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.056263 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.056242 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/354fe887-8a7e-4769-89d4-45bbecde7427-trusted-ca\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.057478 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.057454 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/354fe887-8a7e-4769-89d4-45bbecde7427-installation-pull-secrets\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.057557 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.057523 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/354fe887-8a7e-4769-89d4-45bbecde7427-image-registry-private-configuration\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.057557 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.057533 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/354fe887-8a7e-4769-89d4-45bbecde7427-registry-tls\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.066274 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.066247 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/354fe887-8a7e-4769-89d4-45bbecde7427-bound-sa-token\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.066711 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.066690 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfp4z\" (UniqueName: \"kubernetes.io/projected/354fe887-8a7e-4769-89d4-45bbecde7427-kube-api-access-gfp4z\") pod \"image-registry-696b9bdf5b-rghsb\" (UID: \"354fe887-8a7e-4769-89d4-45bbecde7427\") " pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.103309 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.103275 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:18.227268 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.227244 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-696b9bdf5b-rghsb"] Jun 14 20:22:18.229460 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:22:18.229437 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354fe887_8a7e_4769_89d4_45bbecde7427.slice/crio-26c2e814edfb840ca51569b3a3d953b1517729a76d4250993b0ab5ea845e1133 WatchSource:0}: Error finding container 26c2e814edfb840ca51569b3a3d953b1517729a76d4250993b0ab5ea845e1133: Status 404 returned error can't find the container with id 26c2e814edfb840ca51569b3a3d953b1517729a76d4250993b0ab5ea845e1133 Jun 14 20:22:18.374198 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.374097 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" event={"ID":"354fe887-8a7e-4769-89d4-45bbecde7427","Type":"ContainerStarted","Data":"2a89598418a8dd78c79a08d347a783da536fac7c04c052d91693f06277e6e696"} Jun 14 20:22:18.374198 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.374154 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" event={"ID":"354fe887-8a7e-4769-89d4-45bbecde7427","Type":"ContainerStarted","Data":"26c2e814edfb840ca51569b3a3d953b1517729a76d4250993b0ab5ea845e1133"} Jun 14 20:22:18.374392 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:18.374238 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:23.397684 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:23.397580 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:22:23.399947 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:23.399924 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c228186-a35c-4a42-8470-6eba1873b428-metrics-certs\") pod \"network-metrics-daemon-khjh8\" (UID: \"7c228186-a35c-4a42-8470-6eba1873b428\") " pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:22:23.417536 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:23.417513 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7cfxq\"" Jun 14 20:22:23.425706 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:23.425681 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khjh8" Jun 14 20:22:23.549009 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:23.548949 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" podStartSLOduration=6.548928314 podStartE2EDuration="6.548928314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:18.391906684 +0000 UTC m=+247.176383292" watchObservedRunningTime="2026-06-14 20:22:23.548928314 +0000 UTC m=+252.333404903" Jun 14 20:22:23.550032 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:23.550014 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-khjh8"] Jun 14 20:22:23.552597 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:22:23.552570 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c228186_a35c_4a42_8470_6eba1873b428.slice/crio-669eef5f281d2be718140e40a2baa84d2bad4ac1c4f3f23068583c569e38be40 WatchSource:0}: Error finding container 669eef5f281d2be718140e40a2baa84d2bad4ac1c4f3f23068583c569e38be40: Status 404 returned error can't find the container with id 669eef5f281d2be718140e40a2baa84d2bad4ac1c4f3f23068583c569e38be40 Jun 14 20:22:24.392943 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:24.392905 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khjh8" event={"ID":"7c228186-a35c-4a42-8470-6eba1873b428","Type":"ContainerStarted","Data":"669eef5f281d2be718140e40a2baa84d2bad4ac1c4f3f23068583c569e38be40"} Jun 14 20:22:25.398398 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:25.398359 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khjh8" event={"ID":"7c228186-a35c-4a42-8470-6eba1873b428","Type":"ContainerStarted","Data":"9f99ecfec696e5ef38bd413fe111fc274079a5522c6ebe940adb9a666adaba9e"} Jun 14 20:22:25.398829 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:25.398430 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khjh8" event={"ID":"7c228186-a35c-4a42-8470-6eba1873b428","Type":"ContainerStarted","Data":"2d3a1b60ad89da6f3853007591fb86370dd83c37b8d97f85ad906cc862949fa8"} Jun 14 20:22:25.414560 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:25.414514 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-khjh8" podStartSLOduration=253.444486928 podStartE2EDuration="4m14.414497277s" totalImagesPullingTime="970.010349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:25.413931097 +0000 UTC m=+254.198407709" watchObservedRunningTime="2026-06-14 20:22:25.414497277 +0000 UTC m=+254.198973878" Jun 14 20:22:27.831330 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:27.831289 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:22:27.833613 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:27.833573 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab64754-87a9-4388-b82d-3fd889ec732f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4ct\" (UID: \"6ab64754-87a9-4388-b82d-3fd889ec732f\") " pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:22:28.110404 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:28.110319 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nr27v\"" Jun 14 20:22:28.119312 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:28.119279 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lx4ct" Jun 14 20:22:28.245040 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:28.245002 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lx4ct"] Jun 14 20:22:28.248156 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:22:28.248132 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab64754_87a9_4388_b82d_3fd889ec732f.slice/crio-7133d0a63716cc3bd7da95a9b4191f42a448a472b7c622b3b385a21b76de2dad WatchSource:0}: Error finding container 7133d0a63716cc3bd7da95a9b4191f42a448a472b7c622b3b385a21b76de2dad: Status 404 returned error can't find the container with id 7133d0a63716cc3bd7da95a9b4191f42a448a472b7c622b3b385a21b76de2dad Jun 14 20:22:28.409338 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:28.409243 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx4ct" event={"ID":"6ab64754-87a9-4388-b82d-3fd889ec732f","Type":"ContainerStarted","Data":"7133d0a63716cc3bd7da95a9b4191f42a448a472b7c622b3b385a21b76de2dad"} Jun 14 20:22:32.431174 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:32.431138 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx4ct" event={"ID":"6ab64754-87a9-4388-b82d-3fd889ec732f","Type":"ContainerStarted","Data":"f1e05c105c7a93a3fa45fa2964422a6d8d8b48d704b1e638c2258f0c7220ebeb"} Jun 14 20:22:32.431532 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:32.431197 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx4ct" event={"ID":"6ab64754-87a9-4388-b82d-3fd889ec732f","Type":"ContainerStarted","Data":"5fdb65919075367ad859bf18ee8ad0e86837312d9f4d75fcb427f38c3da3de3f"} Jun 14 20:22:34.439727 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:34.439689 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx4ct" event={"ID":"6ab64754-87a9-4388-b82d-3fd889ec732f","Type":"ContainerStarted","Data":"d71517bdb26f537aceb300e8fabb575f67fc23d8b999786fa5b6981810d34479"} Jun 14 20:22:34.456435 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:34.456377 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lx4ct" podStartSLOduration=33.909985542 podStartE2EDuration="39.456360388s" totalImagesPullingTime="5.546374846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:21:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:34.455637143 +0000 UTC m=+263.240113734" watchObservedRunningTime="2026-06-14 20:22:34.456360388 +0000 UTC m=+263.240836978" Jun 14 20:22:36.205501 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.205466 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sr988"] Jun 14 20:22:36.208856 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.208833 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.211193 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.211169 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 20:22:36.211345 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.211169 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 20:22:36.211345 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.211220 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v6w2h\"" Jun 14 20:22:36.211345 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.211169 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 20:22:36.212282 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.212260 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 20:22:36.212401 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.212290 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 20:22:36.212401 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.212336 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 20:22:36.292117 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.292068 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd428857-4908-4839-96be-03f0a42e4688-sys\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.292117 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.292117 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd428857-4908-4839-96be-03f0a42e4688-root\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.292117 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.292141 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-wtmp\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.292385 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.292205 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-textfile\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.292385 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.292260 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd428857-4908-4839-96be-03f0a42e4688-metrics-client-ca\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.292385 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.292283 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-accelerators-collector-config\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.292385 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.292314 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p65m\" (UniqueName: \"kubernetes.io/projected/cd428857-4908-4839-96be-03f0a42e4688-kube-api-access-6p65m\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.292385 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.292343 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-tls\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.292537 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.292401 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393160 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393115 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd428857-4908-4839-96be-03f0a42e4688-sys\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393160 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393163 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd428857-4908-4839-96be-03f0a42e4688-root\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393366 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393183 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-wtmp\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393366 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393202 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-textfile\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393366 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393245 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd428857-4908-4839-96be-03f0a42e4688-sys\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393366 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393258 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd428857-4908-4839-96be-03f0a42e4688-metrics-client-ca\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393366 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393245 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd428857-4908-4839-96be-03f0a42e4688-root\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393366 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393330 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-wtmp\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393366 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393308 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-accelerators-collector-config\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393704 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393397 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p65m\" (UniqueName: \"kubernetes.io/projected/cd428857-4908-4839-96be-03f0a42e4688-kube-api-access-6p65m\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393704 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393444 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-tls\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393704 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393477 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393704 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:22:36.393547 2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 20:22:36.393704 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393579 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-textfile\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393704 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:22:36.393620 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-tls podName:cd428857-4908-4839-96be-03f0a42e4688 nodeName:}" failed. No retries permitted until 2026-06-14 20:22:36.893599613 +0000 UTC m=+265.678076194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-tls") pod "node-exporter-sr988" (UID: "cd428857-4908-4839-96be-03f0a42e4688") : secret "node-exporter-tls" not found Jun 14 20:22:36.393999 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393870 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd428857-4908-4839-96be-03f0a42e4688-metrics-client-ca\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.393999 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.393930 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-accelerators-collector-config\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.395789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.395767 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.401702 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.401680 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p65m\" (UniqueName: \"kubernetes.io/projected/cd428857-4908-4839-96be-03f0a42e4688-kube-api-access-6p65m\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.896942 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.896906 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-tls\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:36.899272 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:36.899245 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd428857-4908-4839-96be-03f0a42e4688-node-exporter-tls\") pod \"node-exporter-sr988\" (UID: \"cd428857-4908-4839-96be-03f0a42e4688\") " pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:37.118149 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:37.118109 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sr988" Jun 14 20:22:37.129579 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:22:37.129546 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd428857_4908_4839_96be_03f0a42e4688.slice/crio-8d8211ab37225c566a6142a764eadfa0e61dd35f3b06a348357ceb4d04d5093a WatchSource:0}: Error finding container 8d8211ab37225c566a6142a764eadfa0e61dd35f3b06a348357ceb4d04d5093a: Status 404 returned error can't find the container with id 8d8211ab37225c566a6142a764eadfa0e61dd35f3b06a348357ceb4d04d5093a Jun 14 20:22:37.450564 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:37.450527 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sr988" event={"ID":"cd428857-4908-4839-96be-03f0a42e4688","Type":"ContainerStarted","Data":"8d8211ab37225c566a6142a764eadfa0e61dd35f3b06a348357ceb4d04d5093a"} Jun 14 20:22:38.109649 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:38.109607 2549 patch_prober.go:28] interesting pod/image-registry-696b9bdf5b-rghsb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 20:22:38.109791 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:38.109674 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" podUID="354fe887-8a7e-4769-89d4-45bbecde7427" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:22:38.455690 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:38.455654 2549 generic.go:356] "Generic (PLEG): container finished" podID="cd428857-4908-4839-96be-03f0a42e4688" containerID="68aab4e436311de05a06b2cbd7b1d52a10ce2b0b989a5aae2a89a2b5a22980b4" exitCode=0 Jun 14 20:22:38.456050 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:38.455704 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sr988" event={"ID":"cd428857-4908-4839-96be-03f0a42e4688","Type":"ContainerDied","Data":"68aab4e436311de05a06b2cbd7b1d52a10ce2b0b989a5aae2a89a2b5a22980b4"} Jun 14 20:22:39.382038 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:39.381997 2549 patch_prober.go:28] interesting pod/image-registry-696b9bdf5b-rghsb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 20:22:39.382206 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:39.382054 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" podUID="354fe887-8a7e-4769-89d4-45bbecde7427" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:22:39.463264 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:39.463226 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sr988" event={"ID":"cd428857-4908-4839-96be-03f0a42e4688","Type":"ContainerStarted","Data":"d090f2bb3bbc82c852857529ebe1611dbbe5191c90f3bbe919d43e785676dd94"} Jun 14 20:22:39.463697 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:39.463293 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sr988" event={"ID":"cd428857-4908-4839-96be-03f0a42e4688","Type":"ContainerStarted","Data":"50a0b672ea3127723b5209b80d938376aeb0cfe599ad35b23105e8c03a8a3977"} Jun 14 20:22:39.486069 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:39.486018 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sr988" podStartSLOduration=2.446663012 podStartE2EDuration="3.48600035s" totalImagesPullingTime="975.885277ms" totalInitContainerRuntime="63.452061ms" isStatefulPod=true podCreationTimestamp="2026-06-14 20:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:39.484475248 +0000 UTC m=+268.268951839" watchObservedRunningTime="2026-06-14 20:22:39.48600035 +0000 UTC m=+268.270476941" Jun 14 20:22:42.377432 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.377392 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 20:22:42.380844 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.380828 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.383417 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.383394 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 20:22:42.383573 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.383547 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 20:22:42.383648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.383628 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2cl26\"" Jun 14 20:22:42.383875 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.383847 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 20:22:42.383982 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.383871 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 20:22:42.383982 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.383920 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 20:22:42.383982 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.383923 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 20:22:42.384511 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.384445 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-mtipb2m4o3sn\"" Jun 14 20:22:42.384511 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.384471 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 20:22:42.384746 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.384526 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 20:22:42.384746 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.384537 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 20:22:42.384926 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.384788 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 20:22:42.384926 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.384852 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 20:22:42.385058 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.385028 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 20:22:42.385058 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.385030 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 20:22:42.385197 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.385062 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 20:22:42.387066 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.387044 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 20:22:42.397551 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.397523 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 20:22:42.438510 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438473 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.438510 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438515 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.438789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438535 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.438789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438553 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-config\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.438789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438608 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.438789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438643 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.438789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438672 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.438789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438696 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.438789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438738 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.438789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438789 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438845 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438878 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9rsh\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-kube-api-access-p9rsh\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438909 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438927 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.438990 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.439014 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.439045 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.439076 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.439166 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.439215 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.439191 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.540498 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540438 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.540498 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540498 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.540749 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540525 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-config\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.540749 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540558 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.540749 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540583 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.540749 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540636 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.540749 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540678 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.540749 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540721 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.540749 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540745 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540778 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540887 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9rsh\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-kube-api-access-p9rsh\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540923 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540950 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.540992 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.541017 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.541042 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.541064 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.541129 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541570 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.541155 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541570 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.541203 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541570 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.541268 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.541722 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.541707 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.543350 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.542309 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.543350 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.542973 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.543592 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.543564 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.543883 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.543857 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.544098 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.544075 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.544322 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.544295 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.544394 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.544343 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.544494 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.544472 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.544643 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.544587 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.544643 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.544601 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.544643 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.544584 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.545261 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.545215 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.546485 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.546455 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.546879 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.546789 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.546879 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.546840 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.547034 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.547014 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.547210 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.547193 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-config\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.548873 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.548853 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9rsh\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-kube-api-access-p9rsh\") pod \"prometheus-k8s-0\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.691088 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.690981 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:42.830367 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:42.830341 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 20:22:42.831434 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:22:42.831405 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de45880_a951_4e10_983c_e3d4b6d348e1.slice/crio-0cb559bac5376befc2cce86c0e0aebfa9e13e961e437eff6c60bad88a9a157b5 WatchSource:0}: Error finding container 0cb559bac5376befc2cce86c0e0aebfa9e13e961e437eff6c60bad88a9a157b5: Status 404 returned error can't find the container with id 0cb559bac5376befc2cce86c0e0aebfa9e13e961e437eff6c60bad88a9a157b5 Jun 14 20:22:43.484820 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:43.484768 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerStarted","Data":"0cb559bac5376befc2cce86c0e0aebfa9e13e961e437eff6c60bad88a9a157b5"} Jun 14 20:22:44.489582 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:44.489535 2549 generic.go:356] "Generic (PLEG): container finished" podID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerID="f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6" exitCode=0 Jun 14 20:22:44.490102 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:44.489617 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerDied","Data":"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6"} Jun 14 20:22:48.108066 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:48.108022 2549 patch_prober.go:28] interesting pod/image-registry-696b9bdf5b-rghsb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 20:22:48.108517 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:48.108076 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" podUID="354fe887-8a7e-4769-89d4-45bbecde7427" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:22:48.507497 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:48.507464 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerStarted","Data":"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495"} Jun 14 20:22:48.507649 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:48.507534 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerStarted","Data":"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f"} Jun 14 20:22:49.382630 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:49.382592 2549 patch_prober.go:28] interesting pod/image-registry-696b9bdf5b-rghsb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 20:22:49.382963 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:49.382648 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" podUID="354fe887-8a7e-4769-89d4-45bbecde7427" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:22:49.516666 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:49.516576 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerStarted","Data":"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6"} Jun 14 20:22:49.516848 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:49.516707 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerStarted","Data":"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a"} Jun 14 20:22:49.516848 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:49.516751 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerStarted","Data":"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0"} Jun 14 20:22:49.516848 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:49.516790 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerStarted","Data":"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0"} Jun 14 20:22:49.546668 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:49.546595 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.986051327 podStartE2EDuration="7.546571473s" totalImagesPullingTime="5.540460328s" totalInitContainerRuntime="20.059818ms" isStatefulPod=false podCreationTimestamp="2026-06-14 20:22:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:49.545434033 +0000 UTC m=+278.329910624" watchObservedRunningTime="2026-06-14 20:22:49.546571473 +0000 UTC m=+278.331048065" Jun 14 20:22:52.691390 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:52.691349 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:22:53.127468 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:22:53.127421 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-whcdl" podUID="1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313" Jun 14 20:22:53.529625 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:53.529592 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whcdl" Jun 14 20:22:56.064931 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:56.064871 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:22:56.067380 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:56.067353 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313-metrics-tls\") pod \"dns-default-whcdl\" (UID: \"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313\") " pod="openshift-dns/dns-default-whcdl" Jun 14 20:22:56.232630 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:56.232597 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qhwh9\"" Jun 14 20:22:56.240687 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:56.240659 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whcdl" Jun 14 20:22:56.372618 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:56.372584 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whcdl"] Jun 14 20:22:56.375876 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:22:56.375847 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4201c9_61d8_48a2_a7fb_9c1f7f8eb313.slice/crio-bbd06aacd5d3e3eb29baecd857aac064e85ef4e3277a38e75e771026e27b9e57 WatchSource:0}: Error finding container bbd06aacd5d3e3eb29baecd857aac064e85ef4e3277a38e75e771026e27b9e57: Status 404 returned error can't find the container with id bbd06aacd5d3e3eb29baecd857aac064e85ef4e3277a38e75e771026e27b9e57 Jun 14 20:22:56.540599 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:56.540563 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whcdl" event={"ID":"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313","Type":"ContainerStarted","Data":"bbd06aacd5d3e3eb29baecd857aac064e85ef4e3277a38e75e771026e27b9e57"} Jun 14 20:22:58.107930 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.107845 2549 patch_prober.go:28] interesting pod/image-registry-696b9bdf5b-rghsb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 20:22:58.107930 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.107901 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" podUID="354fe887-8a7e-4769-89d4-45bbecde7427" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:22:58.108404 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.107942 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:22:58.108459 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.108398 2549 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"2a89598418a8dd78c79a08d347a783da536fac7c04c052d91693f06277e6e696"} pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" containerMessage="Container registry failed liveness probe, will be restarted" Jun 14 20:22:58.112238 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.112211 2549 patch_prober.go:28] interesting pod/image-registry-696b9bdf5b-rghsb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 20:22:58.112369 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.112251 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" podUID="354fe887-8a7e-4769-89d4-45bbecde7427" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:22:58.554238 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.554196 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whcdl" event={"ID":"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313","Type":"ContainerStarted","Data":"2f20cc38b6927e74b8190f2f36410238cbe5bbf1e43fcb246b1ec71e5de1696f"} Jun 14 20:22:58.554454 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.554297 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whcdl" event={"ID":"1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313","Type":"ContainerStarted","Data":"4cd5df9681bbddd6ba6b90b3f1bbf673106a2f7b888b5b838321ce30a4c5f12e"} Jun 14 20:22:58.554454 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.554329 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-whcdl" Jun 14 20:22:58.570672 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:22:58.570616 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-whcdl" podStartSLOduration=251.160256383 podStartE2EDuration="4m12.570599187s" totalImagesPullingTime="1.410342804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:58.569616287 +0000 UTC m=+287.354092879" watchObservedRunningTime="2026-06-14 20:22:58.570599187 +0000 UTC m=+287.355075777" Jun 14 20:23:08.112681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:08.112648 2549 patch_prober.go:28] interesting pod/image-registry-696b9bdf5b-rghsb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 20:23:08.113170 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:08.112700 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" podUID="354fe887-8a7e-4769-89d4-45bbecde7427" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:23:08.560367 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:08.560336 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-whcdl" Jun 14 20:23:11.566874 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:11.566842 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:23:11.567372 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:11.566997 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:23:11.578817 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:11.578779 2549 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 20:23:11.598753 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:11.598717 2549 generic.go:356] "Generic (PLEG): container finished" podID="eb092e32-b025-412f-b6d3-b26de843e3a4" containerID="ee8a5ff8e25b25990772c7baf4e1c98e761b7b3ed703f919b12219bd78f9e96b" exitCode=0 Jun 14 20:23:11.598928 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:11.598807 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" event={"ID":"eb092e32-b025-412f-b6d3-b26de843e3a4","Type":"ContainerDied","Data":"ee8a5ff8e25b25990772c7baf4e1c98e761b7b3ed703f919b12219bd78f9e96b"} Jun 14 20:23:11.599173 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:11.599156 2549 scope.go:117] "RemoveContainer" containerID="ee8a5ff8e25b25990772c7baf4e1c98e761b7b3ed703f919b12219bd78f9e96b" Jun 14 20:23:12.603943 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:12.603908 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-zgpl7" event={"ID":"eb092e32-b025-412f-b6d3-b26de843e3a4","Type":"ContainerStarted","Data":"39380f9d835334221e03972a78b0c8de8ff05c7f1e22b65a9c7cf1f431498afa"} Jun 14 20:23:18.112896 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:18.112858 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:23:21.416982 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:21.416946 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lfmgm_798a36ad-73f8-4038-8fd7-88530c89f53a/serve-healthcheck-canary/0.log" Jun 14 20:23:23.128416 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:23.128358 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" podUID="354fe887-8a7e-4769-89d4-45bbecde7427" containerName="registry" containerID="cri-o://2a89598418a8dd78c79a08d347a783da536fac7c04c052d91693f06277e6e696" gracePeriod=30 Jun 14 20:23:24.650283 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:24.650250 2549 generic.go:356] "Generic (PLEG): container finished" podID="354fe887-8a7e-4769-89d4-45bbecde7427" containerID="2a89598418a8dd78c79a08d347a783da536fac7c04c052d91693f06277e6e696" exitCode=0 Jun 14 20:23:24.650684 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:24.650308 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" event={"ID":"354fe887-8a7e-4769-89d4-45bbecde7427","Type":"ContainerDied","Data":"2a89598418a8dd78c79a08d347a783da536fac7c04c052d91693f06277e6e696"} Jun 14 20:23:24.650684 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:24.650348 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" event={"ID":"354fe887-8a7e-4769-89d4-45bbecde7427","Type":"ContainerStarted","Data":"52fb3f251d0d16225a3de50e41fa5081d569e1abb81fbf92a6e3b6a1e8bcffea"} Jun 14 20:23:24.650684 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:24.650412 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:23:37.295258 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:37.295210 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" podUID="7db0a423-8818-4234-966b-07860c2dfafb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 20:23:42.691113 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:42.691069 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:23:42.710271 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:42.710240 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:23:42.728710 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:42.728676 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:23:45.658312 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:45.658283 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-696b9bdf5b-rghsb" Jun 14 20:23:47.295024 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:47.294979 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" podUID="7db0a423-8818-4234-966b-07860c2dfafb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 20:23:57.294785 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:57.294741 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" podUID="7db0a423-8818-4234-966b-07860c2dfafb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 20:23:57.295219 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:57.294845 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" Jun 14 20:23:57.295435 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:57.295416 2549 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"dc6e5805c09ad43c829632400ef1575e44df63b7713f0e07b0f782a1c05a6020"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 14 20:23:57.295473 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:57.295458 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" podUID="7db0a423-8818-4234-966b-07860c2dfafb" containerName="service-proxy" containerID="cri-o://dc6e5805c09ad43c829632400ef1575e44df63b7713f0e07b0f782a1c05a6020" gracePeriod=30 Jun 14 20:23:57.766288 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:57.766176 2549 generic.go:356] "Generic (PLEG): container finished" podID="7db0a423-8818-4234-966b-07860c2dfafb" containerID="dc6e5805c09ad43c829632400ef1575e44df63b7713f0e07b0f782a1c05a6020" exitCode=2 Jun 14 20:23:57.766466 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:57.766294 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" event={"ID":"7db0a423-8818-4234-966b-07860c2dfafb","Type":"ContainerDied","Data":"dc6e5805c09ad43c829632400ef1575e44df63b7713f0e07b0f782a1c05a6020"} Jun 14 20:23:57.766466 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:23:57.766334 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dcb7cd958-b7q99" event={"ID":"7db0a423-8818-4234-966b-07860c2dfafb","Type":"ContainerStarted","Data":"50bafec43157854b4245123b48253b6a18b08a0c41b00c26476ec47be5949f51"} Jun 14 20:24:00.715716 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:00.715677 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 20:24:00.716180 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:00.715980 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="prometheus" containerID="cri-o://9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" gracePeriod=600 Jun 14 20:24:00.716180 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:00.716029 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy" containerID="cri-o://6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" gracePeriod=600 Jun 14 20:24:00.716180 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:00.716059 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" gracePeriod=600 Jun 14 20:24:00.716180 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:00.716029 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="thanos-sidecar" containerID="cri-o://69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" gracePeriod=600 Jun 14 20:24:00.716180 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:00.716068 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="config-reloader" containerID="cri-o://d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" gracePeriod=600 Jun 14 20:24:00.716180 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:00.716072 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy-web" containerID="cri-o://6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" gracePeriod=600 Jun 14 20:24:00.963811 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:00.963780 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.066140 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066061 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-db\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066140 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066099 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-kube-rbac-proxy\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066140 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066129 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-tls\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066397 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066161 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066397 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066199 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-web-config\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066397 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066221 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-grpc-tls\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066397 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066248 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-tls-assets\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066397 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066273 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-trusted-ca-bundle\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066693 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066668 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:24:01.066755 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066734 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-1\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066833 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066759 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-metrics-client-certs\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066833 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066823 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066951 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066855 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-config\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066951 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066879 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-kubelet-serving-ca-bundle\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066951 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066908 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-config-out\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.066951 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066935 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-serving-certs-ca-bundle\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.067157 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066973 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-metrics-client-ca\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.067157 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.066997 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-thanos-prometheus-http-client-file\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.067157 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.067027 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-2\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.067157 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.067054 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-0\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.067157 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.067089 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9rsh\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-kube-api-access-p9rsh\") pod \"1de45880-a951-4e10-983c-e3d4b6d348e1\" (UID: \"1de45880-a951-4e10-983c-e3d4b6d348e1\") " Jun 14 20:24:01.067417 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.067316 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.067751 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.067723 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:24:01.068163 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.068134 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:24:01.069711 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.069512 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:24:01.069867 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.069735 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:24:01.069867 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.069746 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:24:01.069976 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.069867 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:24:01.069976 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.069946 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:24:01.070338 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.070305 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:24:01.070429 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.070392 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-config" (OuterVolumeSpecName: "config") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:24:01.070484 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.070440 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:24:01.070681 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.070652 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:24:01.070923 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.070883 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:24:01.071032 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.070965 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:24:01.071090 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.071034 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:24:01.071156 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.071132 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:24:01.071348 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.071324 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-kube-api-access-p9rsh" (OuterVolumeSpecName: "kube-api-access-p9rsh") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "kube-api-access-p9rsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:24:01.071897 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.071872 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:24:01.072128 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.072110 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-config-out" (OuterVolumeSpecName: "config-out") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:24:01.078956 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.078936 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-web-config" (OuterVolumeSpecName: "web-config") pod "1de45880-a951-4e10-983c-e3d4b6d348e1" (UID: "1de45880-a951-4e10-983c-e3d4b6d348e1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:24:01.168378 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168351 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168378 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168374 2549 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-config\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168384 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168394 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-config-out\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168404 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168414 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-configmap-metrics-client-ca\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168423 2549 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168431 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168440 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168449 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9rsh\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-kube-api-access-p9rsh\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168457 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-db\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168465 2549 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-kube-rbac-proxy\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168473 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168481 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168489 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-web-config\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168497 2549 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-grpc-tls\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168504 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1de45880-a951-4e10-983c-e3d4b6d348e1-tls-assets\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168511 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1de45880-a951-4e10-983c-e3d4b6d348e1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.168523 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.168519 2549 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1de45880-a951-4e10-983c-e3d4b6d348e1-secret-metrics-client-certs\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:24:01.783060 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783028 2549 generic.go:356] "Generic (PLEG): container finished" podID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerID="5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" exitCode=0 Jun 14 20:24:01.783060 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783052 2549 generic.go:356] "Generic (PLEG): container finished" podID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerID="6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" exitCode=0 Jun 14 20:24:01.783060 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783059 2549 generic.go:356] "Generic (PLEG): container finished" podID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerID="6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" exitCode=0 Jun 14 20:24:01.783060 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783065 2549 generic.go:356] "Generic (PLEG): container finished" podID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerID="69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" exitCode=0 Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783070 2549 generic.go:356] "Generic (PLEG): container finished" podID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerID="d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" exitCode=0 Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783076 2549 generic.go:356] "Generic (PLEG): container finished" podID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerID="9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" exitCode=0 Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783112 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783110 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerDied","Data":"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6"} Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783248 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerDied","Data":"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a"} Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783278 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerDied","Data":"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0"} Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783302 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerDied","Data":"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0"} Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783323 2549 scope.go:117] "RemoveContainer" containerID="5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783327 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerDied","Data":"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495"} Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783438 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerDied","Data":"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f"} Jun 14 20:24:01.783604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.783463 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1de45880-a951-4e10-983c-e3d4b6d348e1","Type":"ContainerDied","Data":"0cb559bac5376befc2cce86c0e0aebfa9e13e961e437eff6c60bad88a9a157b5"} Jun 14 20:24:01.791789 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.791773 2549 scope.go:117] "RemoveContainer" containerID="6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" Jun 14 20:24:01.798734 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.798717 2549 scope.go:117] "RemoveContainer" containerID="6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" Jun 14 20:24:01.804762 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.804751 2549 scope.go:117] "RemoveContainer" containerID="69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" Jun 14 20:24:01.806922 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.806901 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 20:24:01.811640 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.811618 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 20:24:01.811978 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.811965 2549 scope.go:117] "RemoveContainer" containerID="d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" Jun 14 20:24:01.819665 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.819652 2549 scope.go:117] "RemoveContainer" containerID="9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" Jun 14 20:24:01.826185 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.826169 2549 scope.go:117] "RemoveContainer" containerID="f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6" Jun 14 20:24:01.832398 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.832378 2549 scope.go:117] "RemoveContainer" containerID="5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" Jun 14 20:24:01.832658 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:24:01.832637 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": container with ID starting with 5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6 not found: ID does not exist" containerID="5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" Jun 14 20:24:01.832718 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.832666 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6"} err="failed to get container status \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": rpc error: code = NotFound desc = could not find container \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": container with ID starting with 5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6 not found: ID does not exist" Jun 14 20:24:01.832718 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.832689 2549 scope.go:117] "RemoveContainer" containerID="6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" Jun 14 20:24:01.832980 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:24:01.832930 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": container with ID starting with 6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a not found: ID does not exist" containerID="6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" Jun 14 20:24:01.832980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.832952 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a"} err="failed to get container status \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": rpc error: code = NotFound desc = could not find container \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": container with ID starting with 6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a not found: ID does not exist" Jun 14 20:24:01.832980 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.832966 2549 scope.go:117] "RemoveContainer" containerID="6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" Jun 14 20:24:01.833204 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:24:01.833180 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": container with ID starting with 6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0 not found: ID does not exist" containerID="6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" Jun 14 20:24:01.833204 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.833198 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0"} err="failed to get container status \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": rpc error: code = NotFound desc = could not find container \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": container with ID starting with 6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0 not found: ID does not exist" Jun 14 20:24:01.833290 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.833210 2549 scope.go:117] "RemoveContainer" containerID="69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" Jun 14 20:24:01.833484 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:24:01.833452 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": container with ID starting with 69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0 not found: ID does not exist" containerID="69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" Jun 14 20:24:01.833562 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.833490 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0"} err="failed to get container status \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": rpc error: code = NotFound desc = could not find container \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": container with ID starting with 69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0 not found: ID does not exist" Jun 14 20:24:01.833562 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.833509 2549 scope.go:117] "RemoveContainer" containerID="d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" Jun 14 20:24:01.833814 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:24:01.833766 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": container with ID starting with d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495 not found: ID does not exist" containerID="d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" Jun 14 20:24:01.833898 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.833819 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495"} err="failed to get container status \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": rpc error: code = NotFound desc = could not find container \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": container with ID starting with d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495 not found: ID does not exist" Jun 14 20:24:01.833898 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.833847 2549 scope.go:117] "RemoveContainer" containerID="9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" Jun 14 20:24:01.834166 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:24:01.834143 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": container with ID starting with 9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f not found: ID does not exist" containerID="9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" Jun 14 20:24:01.834254 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.834171 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f"} err="failed to get container status \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": rpc error: code = NotFound desc = could not find container \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": container with ID starting with 9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f not found: ID does not exist" Jun 14 20:24:01.834254 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.834190 2549 scope.go:117] "RemoveContainer" containerID="f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6" Jun 14 20:24:01.834445 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:24:01.834428 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": container with ID starting with f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6 not found: ID does not exist" containerID="f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6" Jun 14 20:24:01.834498 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.834449 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6"} err="failed to get container status \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": rpc error: code = NotFound desc = could not find container \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": container with ID starting with f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6 not found: ID does not exist" Jun 14 20:24:01.834498 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.834463 2549 scope.go:117] "RemoveContainer" containerID="5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" Jun 14 20:24:01.834694 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.834677 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6"} err="failed to get container status \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": rpc error: code = NotFound desc = could not find container \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": container with ID starting with 5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6 not found: ID does not exist" Jun 14 20:24:01.834743 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.834696 2549 scope.go:117] "RemoveContainer" containerID="6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" Jun 14 20:24:01.834909 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.834891 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a"} err="failed to get container status \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": rpc error: code = NotFound desc = could not find container \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": container with ID starting with 6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a not found: ID does not exist" Jun 14 20:24:01.834909 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.834907 2549 scope.go:117] "RemoveContainer" containerID="6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" Jun 14 20:24:01.835118 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835100 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0"} err="failed to get container status \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": rpc error: code = NotFound desc = could not find container \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": container with ID starting with 6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0 not found: ID does not exist" Jun 14 20:24:01.835172 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835125 2549 scope.go:117] "RemoveContainer" containerID="69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" Jun 14 20:24:01.835318 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835302 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 20:24:01.835372 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835333 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0"} err="failed to get container status \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": rpc error: code = NotFound desc = could not find container \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": container with ID starting with 69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0 not found: ID does not exist" Jun 14 20:24:01.835372 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835346 2549 scope.go:117] "RemoveContainer" containerID="d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" Jun 14 20:24:01.835517 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835505 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="prometheus" Jun 14 20:24:01.835554 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835520 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="prometheus" Jun 14 20:24:01.835554 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835537 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy-thanos" Jun 14 20:24:01.835554 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835546 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy-thanos" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835557 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy-web" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835566 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy-web" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835583 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835591 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835604 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="init-config-reloader" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835612 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="init-config-reloader" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835621 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="config-reloader" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835629 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="config-reloader" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835638 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="thanos-sidecar" Jun 14 20:24:01.835648 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835644 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="thanos-sidecar" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835604 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495"} err="failed to get container status \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": rpc error: code = NotFound desc = could not find container \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": container with ID starting with d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495 not found: ID does not exist" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835691 2549 scope.go:117] "RemoveContainer" containerID="9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835695 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy-thanos" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835707 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="config-reloader" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835717 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="thanos-sidecar" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835726 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835735 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="prometheus" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835742 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" containerName="kube-rbac-proxy-web" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835929 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f"} err="failed to get container status \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": rpc error: code = NotFound desc = could not find container \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": container with ID starting with 9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f not found: ID does not exist" Jun 14 20:24:01.835983 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.835945 2549 scope.go:117] "RemoveContainer" containerID="f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6" Jun 14 20:24:01.836352 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.836116 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6"} err="failed to get container status \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": rpc error: code = NotFound desc = could not find container \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": container with ID starting with f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6 not found: ID does not exist" Jun 14 20:24:01.836352 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.836127 2549 scope.go:117] "RemoveContainer" containerID="5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" Jun 14 20:24:01.836352 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.836311 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6"} err="failed to get container status \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": rpc error: code = NotFound desc = could not find container \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": container with ID starting with 5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6 not found: ID does not exist" Jun 14 20:24:01.836352 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.836324 2549 scope.go:117] "RemoveContainer" containerID="6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" Jun 14 20:24:01.836522 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.836503 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a"} err="failed to get container status \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": rpc error: code = NotFound desc = could not find container \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": container with ID starting with 6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a not found: ID does not exist" Jun 14 20:24:01.836557 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.836524 2549 scope.go:117] "RemoveContainer" containerID="6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" Jun 14 20:24:01.836780 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.836762 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0"} err="failed to get container status \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": rpc error: code = NotFound desc = could not find container \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": container with ID starting with 6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0 not found: ID does not exist" Jun 14 20:24:01.836850 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.836780 2549 scope.go:117] "RemoveContainer" containerID="69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" Jun 14 20:24:01.837093 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837074 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0"} err="failed to get container status \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": rpc error: code = NotFound desc = could not find container \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": container with ID starting with 69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0 not found: ID does not exist" Jun 14 20:24:01.837139 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837094 2549 scope.go:117] "RemoveContainer" containerID="d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" Jun 14 20:24:01.837291 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837277 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495"} err="failed to get container status \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": rpc error: code = NotFound desc = could not find container \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": container with ID starting with d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495 not found: ID does not exist" Jun 14 20:24:01.837333 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837290 2549 scope.go:117] "RemoveContainer" containerID="9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" Jun 14 20:24:01.837468 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837453 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f"} err="failed to get container status \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": rpc error: code = NotFound desc = could not find container \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": container with ID starting with 9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f not found: ID does not exist" Jun 14 20:24:01.837508 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837468 2549 scope.go:117] "RemoveContainer" containerID="f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6" Jun 14 20:24:01.837693 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837677 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6"} err="failed to get container status \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": rpc error: code = NotFound desc = could not find container \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": container with ID starting with f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6 not found: ID does not exist" Jun 14 20:24:01.837739 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837693 2549 scope.go:117] "RemoveContainer" containerID="5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" Jun 14 20:24:01.837934 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837916 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6"} err="failed to get container status \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": rpc error: code = NotFound desc = could not find container \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": container with ID starting with 5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6 not found: ID does not exist" Jun 14 20:24:01.837934 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.837931 2549 scope.go:117] "RemoveContainer" containerID="6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" Jun 14 20:24:01.838166 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.838149 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a"} err="failed to get container status \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": rpc error: code = NotFound desc = could not find container \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": container with ID starting with 6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a not found: ID does not exist" Jun 14 20:24:01.838211 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.838167 2549 scope.go:117] "RemoveContainer" containerID="6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" Jun 14 20:24:01.838385 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.838367 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0"} err="failed to get container status \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": rpc error: code = NotFound desc = could not find container \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": container with ID starting with 6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0 not found: ID does not exist" Jun 14 20:24:01.838439 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.838386 2549 scope.go:117] "RemoveContainer" containerID="69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" Jun 14 20:24:01.838586 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.838570 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0"} err="failed to get container status \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": rpc error: code = NotFound desc = could not find container \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": container with ID starting with 69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0 not found: ID does not exist" Jun 14 20:24:01.838629 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.838587 2549 scope.go:117] "RemoveContainer" containerID="d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" Jun 14 20:24:01.838816 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.838784 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495"} err="failed to get container status \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": rpc error: code = NotFound desc = could not find container \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": container with ID starting with d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495 not found: ID does not exist" Jun 14 20:24:01.838816 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.838813 2549 scope.go:117] "RemoveContainer" containerID="9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" Jun 14 20:24:01.839017 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.838998 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f"} err="failed to get container status \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": rpc error: code = NotFound desc = could not find container \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": container with ID starting with 9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f not found: ID does not exist" Jun 14 20:24:01.839077 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.839019 2549 scope.go:117] "RemoveContainer" containerID="f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6" Jun 14 20:24:01.839267 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.839251 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6"} err="failed to get container status \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": rpc error: code = NotFound desc = could not find container \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": container with ID starting with f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6 not found: ID does not exist" Jun 14 20:24:01.839317 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.839268 2549 scope.go:117] "RemoveContainer" containerID="5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" Jun 14 20:24:01.839442 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.839424 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6"} err="failed to get container status \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": rpc error: code = NotFound desc = could not find container \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": container with ID starting with 5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6 not found: ID does not exist" Jun 14 20:24:01.839507 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.839445 2549 scope.go:117] "RemoveContainer" containerID="6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" Jun 14 20:24:01.839642 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.839626 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a"} err="failed to get container status \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": rpc error: code = NotFound desc = could not find container \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": container with ID starting with 6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a not found: ID does not exist" Jun 14 20:24:01.839683 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.839642 2549 scope.go:117] "RemoveContainer" containerID="6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" Jun 14 20:24:01.839832 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.839815 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0"} err="failed to get container status \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": rpc error: code = NotFound desc = could not find container \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": container with ID starting with 6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0 not found: ID does not exist" Jun 14 20:24:01.839904 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.839834 2549 scope.go:117] "RemoveContainer" containerID="69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" Jun 14 20:24:01.840075 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840054 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0"} err="failed to get container status \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": rpc error: code = NotFound desc = could not find container \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": container with ID starting with 69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0 not found: ID does not exist" Jun 14 20:24:01.840122 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840076 2549 scope.go:117] "RemoveContainer" containerID="d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" Jun 14 20:24:01.840269 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840250 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495"} err="failed to get container status \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": rpc error: code = NotFound desc = could not find container \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": container with ID starting with d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495 not found: ID does not exist" Jun 14 20:24:01.840269 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840269 2549 scope.go:117] "RemoveContainer" containerID="9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" Jun 14 20:24:01.840466 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840449 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f"} err="failed to get container status \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": rpc error: code = NotFound desc = could not find container \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": container with ID starting with 9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f not found: ID does not exist" Jun 14 20:24:01.840507 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840467 2549 scope.go:117] "RemoveContainer" containerID="f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6" Jun 14 20:24:01.840652 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840636 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6"} err="failed to get container status \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": rpc error: code = NotFound desc = could not find container \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": container with ID starting with f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6 not found: ID does not exist" Jun 14 20:24:01.840693 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840652 2549 scope.go:117] "RemoveContainer" containerID="5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6" Jun 14 20:24:01.840725 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840692 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.840829 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840787 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6"} err="failed to get container status \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": rpc error: code = NotFound desc = could not find container \"5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6\": container with ID starting with 5c92adffe9a0970dd24f1cf8b76896c13051a48ec846d5eb0b1ec584a0fe96f6 not found: ID does not exist" Jun 14 20:24:01.840829 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.840818 2549 scope.go:117] "RemoveContainer" containerID="6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a" Jun 14 20:24:01.841211 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.841094 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a"} err="failed to get container status \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": rpc error: code = NotFound desc = could not find container \"6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a\": container with ID starting with 6be79d7f8cb4097b68abb149e76900d92cdf42b94d393d71321f9f7d37f95a6a not found: ID does not exist" Jun 14 20:24:01.841211 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.841126 2549 scope.go:117] "RemoveContainer" containerID="6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0" Jun 14 20:24:01.841391 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.841365 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0"} err="failed to get container status \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": rpc error: code = NotFound desc = could not find container \"6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0\": container with ID starting with 6fc68c04844e58f4a45aa7d470a5391afd1e2825fbf15fd6b4fc16e22eb5c2f0 not found: ID does not exist" Jun 14 20:24:01.841489 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.841392 2549 scope.go:117] "RemoveContainer" containerID="69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0" Jun 14 20:24:01.841604 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.841585 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0"} err="failed to get container status \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": rpc error: code = NotFound desc = could not find container \"69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0\": container with ID starting with 69e455f6f4c18226e86f17b01a29523fad060ff2c59b2ce4f08e7572379f67b0 not found: ID does not exist" Jun 14 20:24:01.841662 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.841605 2549 scope.go:117] "RemoveContainer" containerID="d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495" Jun 14 20:24:01.841848 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.841828 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495"} err="failed to get container status \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": rpc error: code = NotFound desc = could not find container \"d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495\": container with ID starting with d0bfa4fb4e5dacbe93bc7a72b9e04fca0812a9f4cf90fea62c8ecfe3b8a49495 not found: ID does not exist" Jun 14 20:24:01.841913 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.841851 2549 scope.go:117] "RemoveContainer" containerID="9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f" Jun 14 20:24:01.842107 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.842091 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f"} err="failed to get container status \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": rpc error: code = NotFound desc = could not find container \"9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f\": container with ID starting with 9995808ae5005c35409e970a3882cd728b28bcaeda228c8b18ab960dae91d73f not found: ID does not exist" Jun 14 20:24:01.842157 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.842107 2549 scope.go:117] "RemoveContainer" containerID="f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6" Jun 14 20:24:01.842334 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.842315 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6"} err="failed to get container status \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": rpc error: code = NotFound desc = could not find container \"f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6\": container with ID starting with f225cabecd6a1f98bc163e69e73c233c882935911d3dfa71456ceafce84a25c6 not found: ID does not exist" Jun 14 20:24:01.843368 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843347 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 20:24:01.843473 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843383 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 20:24:01.843473 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843432 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2cl26\"" Jun 14 20:24:01.843473 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843443 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 20:24:01.843473 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843347 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-mtipb2m4o3sn\"" Jun 14 20:24:01.843473 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843347 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 20:24:01.843711 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843697 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 20:24:01.843768 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843753 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 20:24:01.843878 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843863 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 20:24:01.843945 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843901 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 20:24:01.843997 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.843974 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 20:24:01.844043 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.844009 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 20:24:01.844043 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.844019 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 20:24:01.844139 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.844059 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 20:24:01.844334 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.844318 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 20:24:01.847013 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.846992 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 20:24:01.849330 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.849313 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 20:24:01.853659 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.853637 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 20:24:01.974542 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974515 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-config\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974684 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974553 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974684 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974573 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974684 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974607 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974684 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974668 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974836 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974695 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974836 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974719 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974836 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974736 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974836 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974756 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974836 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974770 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.974836 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974811 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.975026 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974842 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.975026 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974864 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.975026 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974878 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.975026 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974899 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.975026 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974939 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7dgl\" (UniqueName: \"kubernetes.io/projected/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-kube-api-access-n7dgl\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.975026 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.974973 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.975225 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.975026 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.975225 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.975045 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:01.975225 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:01.975064 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076091 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076060 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076091 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076092 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076289 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076112 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076289 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076131 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076289 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076152 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076289 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076181 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076289 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076206 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076289 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076236 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076289 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076259 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076289 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076274 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076297 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076327 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076348 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076377 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076406 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dgl\" (UniqueName: \"kubernetes.io/projected/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-kube-api-access-n7dgl\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076429 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076458 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076486 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076519 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.076660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076550 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-config\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.077228 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076901 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.077228 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.076967 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.079400 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.079234 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.081017 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.080837 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.081017 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.080969 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.081059 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.081127 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-config\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.081158 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.081177 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.081623 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.081914 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.081943 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.082116 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.082388 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.082779 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.083326 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.084550 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.087257 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.087402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.087316 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.089092 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.089073 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7dgl\" (UniqueName: \"kubernetes.io/projected/3f82df6c-b7a1-4002-a7ec-baa41d37e9d5-kube-api-access-n7dgl\") pod \"prometheus-k8s-0\" (UID: \"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.151210 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.151156 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:24:02.283286 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.283097 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 20:24:02.285222 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:24:02.285196 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f82df6c_b7a1_4002_a7ec_baa41d37e9d5.slice/crio-75c1ddd64de710e11739ad0e0c524f6e0a6d3c271bb5b1cdf720ab64d75a9841 WatchSource:0}: Error finding container 75c1ddd64de710e11739ad0e0c524f6e0a6d3c271bb5b1cdf720ab64d75a9841: Status 404 returned error can't find the container with id 75c1ddd64de710e11739ad0e0c524f6e0a6d3c271bb5b1cdf720ab64d75a9841 Jun 14 20:24:02.788986 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.788956 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f82df6c-b7a1-4002-a7ec-baa41d37e9d5" containerID="a4590b05a62728d8a39c4b16ce516ee6ca9850dcfbfcc5e9c7e5a081fb2ea8f5" exitCode=0 Jun 14 20:24:02.789333 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.789001 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5","Type":"ContainerDied","Data":"a4590b05a62728d8a39c4b16ce516ee6ca9850dcfbfcc5e9c7e5a081fb2ea8f5"} Jun 14 20:24:02.789333 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:02.789048 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5","Type":"ContainerStarted","Data":"75c1ddd64de710e11739ad0e0c524f6e0a6d3c271bb5b1cdf720ab64d75a9841"} Jun 14 20:24:03.618068 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:03.618040 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1de45880-a951-4e10-983c-e3d4b6d348e1" path="/var/lib/kubelet/pods/1de45880-a951-4e10-983c-e3d4b6d348e1/volumes" Jun 14 20:24:03.796294 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:03.796258 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5","Type":"ContainerStarted","Data":"b1a166ae7cd6caeb40807b7cff08046c8a2821e062341afcd1a2523243c422c4"} Jun 14 20:24:03.796746 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:03.796339 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5","Type":"ContainerStarted","Data":"92c5fb157efa505c7de2e2147f4148f8a243312bbcdbe7bf0b8adf8387be683c"} Jun 14 20:24:03.796746 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:03.796380 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5","Type":"ContainerStarted","Data":"d9faad76e401116e2aa3e04747c534065c68bb963504120cf52744d7b8ea1a32"} Jun 14 20:24:03.796746 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:03.796417 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5","Type":"ContainerStarted","Data":"b1276d8bd8f20feb0f11a9810f9c4ad003e6fbaf6069468ff03ee410110230d1"} Jun 14 20:24:03.796746 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:03.796456 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5","Type":"ContainerStarted","Data":"c9a8fec132766e91c6294a781b608e58fbfdcfc0f483bece340d3c41f549598c"} Jun 14 20:24:03.796746 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:03.796491 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f82df6c-b7a1-4002-a7ec-baa41d37e9d5","Type":"ContainerStarted","Data":"ce005f87208575688ecd1aab0ac2d03853c3e968b41ad5e447bd3c1298e76549"} Jun 14 20:24:03.822382 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:03.822323 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.805032269 podStartE2EDuration="2.822300211s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.267942ms" isStatefulPod=false podCreationTimestamp="2026-06-14 20:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:24:03.820039303 +0000 UTC m=+352.604515885" watchObservedRunningTime="2026-06-14 20:24:03.822300211 +0000 UTC m=+352.606776802" Jun 14 20:24:07.151467 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:24:07.151411 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:25:02.151514 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:25:02.151474 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:25:02.167239 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:25:02.167208 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:25:03.019622 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:25:03.019592 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 20:27:26.397150 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.397114 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft"] Jun 14 20:27:26.400143 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.400127 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.402844 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.402819 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 20:27:26.402969 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.402823 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 20:27:26.402969 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.402956 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 20:27:26.403055 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.403037 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hcw4f\"" Jun 14 20:27:26.403169 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.403149 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 20:27:26.416819 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.416781 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft"] Jun 14 20:27:26.538152 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.538122 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8809b44c-9fb1-40b9-b314-a5a0255c704c-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.538334 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.538172 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dw57\" (UniqueName: \"kubernetes.io/projected/8809b44c-9fb1-40b9-b314-a5a0255c704c-kube-api-access-9dw57\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.538334 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.538193 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8809b44c-9fb1-40b9-b314-a5a0255c704c-tmp\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.538334 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.538210 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8809b44c-9fb1-40b9-b314-a5a0255c704c-manifests\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.538334 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.538226 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8809b44c-9fb1-40b9-b314-a5a0255c704c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.639295 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.639260 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8809b44c-9fb1-40b9-b314-a5a0255c704c-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.639465 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.639315 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dw57\" (UniqueName: \"kubernetes.io/projected/8809b44c-9fb1-40b9-b314-a5a0255c704c-kube-api-access-9dw57\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.639465 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.639343 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8809b44c-9fb1-40b9-b314-a5a0255c704c-tmp\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.639465 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.639361 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8809b44c-9fb1-40b9-b314-a5a0255c704c-manifests\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.639465 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.639377 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8809b44c-9fb1-40b9-b314-a5a0255c704c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.639860 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.639824 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8809b44c-9fb1-40b9-b314-a5a0255c704c-manifests\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.641657 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.641637 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8809b44c-9fb1-40b9-b314-a5a0255c704c-tmp\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.641760 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.641736 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8809b44c-9fb1-40b9-b314-a5a0255c704c-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.641844 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.641785 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8809b44c-9fb1-40b9-b314-a5a0255c704c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.646907 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.646883 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dw57\" (UniqueName: \"kubernetes.io/projected/8809b44c-9fb1-40b9-b314-a5a0255c704c-kube-api-access-9dw57\") pod \"opendatahub-operator-controller-manager-86cf7969f6-nt8ft\" (UID: \"8809b44c-9fb1-40b9-b314-a5a0255c704c\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.709917 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.709893 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:26.861245 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.861219 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft"] Jun 14 20:27:26.863861 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:27:26.863831 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8809b44c_9fb1_40b9_b314_a5a0255c704c.slice/crio-32a9de0ca0a7873bcae5d534368e75010806e0463edad53449069bb2cbb9e69a WatchSource:0}: Error finding container 32a9de0ca0a7873bcae5d534368e75010806e0463edad53449069bb2cbb9e69a: Status 404 returned error can't find the container with id 32a9de0ca0a7873bcae5d534368e75010806e0463edad53449069bb2cbb9e69a Jun 14 20:27:26.865673 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:26.865655 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 20:27:27.509502 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:27.509461 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" event={"ID":"8809b44c-9fb1-40b9-b314-a5a0255c704c","Type":"ContainerStarted","Data":"32a9de0ca0a7873bcae5d534368e75010806e0463edad53449069bb2cbb9e69a"} Jun 14 20:27:30.523331 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:30.523285 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" event={"ID":"8809b44c-9fb1-40b9-b314-a5a0255c704c","Type":"ContainerStarted","Data":"5615ac70268efc29e69142b475ad9c300d265c2a6be3a259e3ef18a4dfcb824f"} Jun 14 20:27:31.533701 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:31.533666 2549 generic.go:356] "Generic (PLEG): container finished" podID="8809b44c-9fb1-40b9-b314-a5a0255c704c" containerID="5615ac70268efc29e69142b475ad9c300d265c2a6be3a259e3ef18a4dfcb824f" exitCode=0 Jun 14 20:27:31.534122 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:31.533710 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" event={"ID":"8809b44c-9fb1-40b9-b314-a5a0255c704c","Type":"ContainerDied","Data":"5615ac70268efc29e69142b475ad9c300d265c2a6be3a259e3ef18a4dfcb824f"} Jun 14 20:27:32.538933 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:32.538899 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" event={"ID":"8809b44c-9fb1-40b9-b314-a5a0255c704c","Type":"ContainerStarted","Data":"b2f3dc44b0e2aa77b0b92866a1b89d4d74a37963e85bdab26aa53cb105a930bb"} Jun 14 20:27:32.539340 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:32.539037 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:32.560054 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:32.560009 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" podStartSLOduration=2.366688689 podStartE2EDuration="6.559993142s" totalImagesPullingTime="3.129159406s" totalInitContainerRuntime="1.064145047s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:27:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:27:32.559040263 +0000 UTC m=+561.343516891" watchObservedRunningTime="2026-06-14 20:27:32.559993142 +0000 UTC m=+561.344469731" Jun 14 20:27:43.544769 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:43.544739 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-nt8ft" Jun 14 20:27:45.996693 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:45.996659 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-686f9db88b-gntvx"] Jun 14 20:27:46.007320 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.007295 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.014065 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.014040 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 20:27:46.014185 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.014117 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qh7rg\"" Jun 14 20:27:46.015849 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.015198 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 20:27:46.015849 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.015224 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 20:27:46.015849 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.015266 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 20:27:46.017004 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.016983 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686f9db88b-gntvx"] Jun 14 20:27:46.062353 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.062322 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-v8bwc"] Jun 14 20:27:46.066729 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.066713 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:46.069734 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.069715 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kqr96\"" Jun 14 20:27:46.069834 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.069720 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 20:27:46.076256 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.076233 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-v8bwc"] Jun 14 20:27:46.086182 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.086153 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47wp7\" (UniqueName: \"kubernetes.io/projected/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-kube-api-access-47wp7\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.086310 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.086193 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-tmp\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.086310 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.086286 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0cbc31-cc53-4054-8546-0866e4661129-cert\") pod \"odh-model-controller-6dc94f689f-v8bwc\" (UID: \"ad0cbc31-cc53-4054-8546-0866e4661129\") " pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:46.086434 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.086344 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hhlz\" (UniqueName: \"kubernetes.io/projected/ad0cbc31-cc53-4054-8546-0866e4661129-kube-api-access-7hhlz\") pod \"odh-model-controller-6dc94f689f-v8bwc\" (UID: \"ad0cbc31-cc53-4054-8546-0866e4661129\") " pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:46.086434 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.086399 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-tls-certs\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.187613 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.187580 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47wp7\" (UniqueName: \"kubernetes.io/projected/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-kube-api-access-47wp7\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.187613 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.187614 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-tmp\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.187906 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.187663 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0cbc31-cc53-4054-8546-0866e4661129-cert\") pod \"odh-model-controller-6dc94f689f-v8bwc\" (UID: \"ad0cbc31-cc53-4054-8546-0866e4661129\") " pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:46.187906 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.187692 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hhlz\" (UniqueName: \"kubernetes.io/projected/ad0cbc31-cc53-4054-8546-0866e4661129-kube-api-access-7hhlz\") pod \"odh-model-controller-6dc94f689f-v8bwc\" (UID: \"ad0cbc31-cc53-4054-8546-0866e4661129\") " pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:46.187906 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.187724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-tls-certs\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.187906 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:27:46.187832 2549 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 14 20:27:46.187906 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:27:46.187843 2549 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 20:27:46.187906 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:27:46.187893 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-tls-certs podName:fcee1cdb-b049-499f-9b1d-9bf76eee3c2e nodeName:}" failed. No retries permitted until 2026-06-14 20:27:46.68787685 +0000 UTC m=+575.472353422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-tls-certs") pod "kube-auth-proxy-686f9db88b-gntvx" (UID: "fcee1cdb-b049-499f-9b1d-9bf76eee3c2e") : secret "kube-auth-proxy-tls" not found Jun 14 20:27:46.187906 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:27:46.187906 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad0cbc31-cc53-4054-8546-0866e4661129-cert podName:ad0cbc31-cc53-4054-8546-0866e4661129 nodeName:}" failed. No retries permitted until 2026-06-14 20:27:46.687900163 +0000 UTC m=+575.472376732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ad0cbc31-cc53-4054-8546-0866e4661129-cert") pod "odh-model-controller-6dc94f689f-v8bwc" (UID: "ad0cbc31-cc53-4054-8546-0866e4661129") : secret "odh-model-controller-webhook-cert" not found Jun 14 20:27:46.189888 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.189872 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-tmp\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.196694 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.196664 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hhlz\" (UniqueName: \"kubernetes.io/projected/ad0cbc31-cc53-4054-8546-0866e4661129-kube-api-access-7hhlz\") pod \"odh-model-controller-6dc94f689f-v8bwc\" (UID: \"ad0cbc31-cc53-4054-8546-0866e4661129\") " pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:46.196788 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.196695 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47wp7\" (UniqueName: \"kubernetes.io/projected/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-kube-api-access-47wp7\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.625612 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.625578 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hhlth"] Jun 14 20:27:46.627726 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.627709 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:46.633174 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.633154 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 20:27:46.638284 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.638260 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hhlth"] Jun 14 20:27:46.691651 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.691618 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-tls-certs\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.691845 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.691670 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27c35a0f-31c9-491a-8720-9d76dd19e483-tls-certs\") pod \"model-serving-api-5dd488fc48-hhlth\" (UID: \"27c35a0f-31c9-491a-8720-9d76dd19e483\") " pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:46.691845 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.691783 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86fd\" (UniqueName: \"kubernetes.io/projected/27c35a0f-31c9-491a-8720-9d76dd19e483-kube-api-access-c86fd\") pod \"model-serving-api-5dd488fc48-hhlth\" (UID: \"27c35a0f-31c9-491a-8720-9d76dd19e483\") " pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:46.691952 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.691865 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0cbc31-cc53-4054-8546-0866e4661129-cert\") pod \"odh-model-controller-6dc94f689f-v8bwc\" (UID: \"ad0cbc31-cc53-4054-8546-0866e4661129\") " pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:46.694021 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.693996 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcee1cdb-b049-499f-9b1d-9bf76eee3c2e-tls-certs\") pod \"kube-auth-proxy-686f9db88b-gntvx\" (UID: \"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.694146 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.694046 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0cbc31-cc53-4054-8546-0866e4661129-cert\") pod \"odh-model-controller-6dc94f689f-v8bwc\" (UID: \"ad0cbc31-cc53-4054-8546-0866e4661129\") " pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:46.792744 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.792702 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27c35a0f-31c9-491a-8720-9d76dd19e483-tls-certs\") pod \"model-serving-api-5dd488fc48-hhlth\" (UID: \"27c35a0f-31c9-491a-8720-9d76dd19e483\") " pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:46.792744 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.792743 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86fd\" (UniqueName: \"kubernetes.io/projected/27c35a0f-31c9-491a-8720-9d76dd19e483-kube-api-access-c86fd\") pod \"model-serving-api-5dd488fc48-hhlth\" (UID: \"27c35a0f-31c9-491a-8720-9d76dd19e483\") " pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:46.792970 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:27:46.792866 2549 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 14 20:27:46.792970 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:27:46.792929 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c35a0f-31c9-491a-8720-9d76dd19e483-tls-certs podName:27c35a0f-31c9-491a-8720-9d76dd19e483 nodeName:}" failed. No retries permitted until 2026-06-14 20:27:47.29291289 +0000 UTC m=+576.077389463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/27c35a0f-31c9-491a-8720-9d76dd19e483-tls-certs") pod "model-serving-api-5dd488fc48-hhlth" (UID: "27c35a0f-31c9-491a-8720-9d76dd19e483") : secret "model-serving-api-tls" not found Jun 14 20:27:46.809698 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.809673 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86fd\" (UniqueName: \"kubernetes.io/projected/27c35a0f-31c9-491a-8720-9d76dd19e483-kube-api-access-c86fd\") pod \"model-serving-api-5dd488fc48-hhlth\" (UID: \"27c35a0f-31c9-491a-8720-9d76dd19e483\") " pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:46.916288 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.916201 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" Jun 14 20:27:46.976733 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:46.976703 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:47.049032 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:47.049003 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686f9db88b-gntvx"] Jun 14 20:27:47.051667 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:27:47.051640 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcee1cdb_b049_499f_9b1d_9bf76eee3c2e.slice/crio-cb77e31fffd18614cc3a8bdd6a4865199709b8970d46b4e11dcfb908692d2c0d WatchSource:0}: Error finding container cb77e31fffd18614cc3a8bdd6a4865199709b8970d46b4e11dcfb908692d2c0d: Status 404 returned error can't find the container with id cb77e31fffd18614cc3a8bdd6a4865199709b8970d46b4e11dcfb908692d2c0d Jun 14 20:27:47.114217 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:47.114190 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-v8bwc"] Jun 14 20:27:47.116438 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:27:47.116411 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0cbc31_cc53_4054_8546_0866e4661129.slice/crio-5b39ede4cb95c6909d2b73017d7209d2252e7460c4045520d6e1baf4c76fcf4b WatchSource:0}: Error finding container 5b39ede4cb95c6909d2b73017d7209d2252e7460c4045520d6e1baf4c76fcf4b: Status 404 returned error can't find the container with id 5b39ede4cb95c6909d2b73017d7209d2252e7460c4045520d6e1baf4c76fcf4b Jun 14 20:27:47.295844 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:47.295812 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27c35a0f-31c9-491a-8720-9d76dd19e483-tls-certs\") pod \"model-serving-api-5dd488fc48-hhlth\" (UID: \"27c35a0f-31c9-491a-8720-9d76dd19e483\") " pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:47.298169 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:47.298141 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27c35a0f-31c9-491a-8720-9d76dd19e483-tls-certs\") pod \"model-serving-api-5dd488fc48-hhlth\" (UID: \"27c35a0f-31c9-491a-8720-9d76dd19e483\") " pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:47.537533 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:47.537492 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:47.595639 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:47.595608 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" event={"ID":"ad0cbc31-cc53-4054-8546-0866e4661129","Type":"ContainerStarted","Data":"5b39ede4cb95c6909d2b73017d7209d2252e7460c4045520d6e1baf4c76fcf4b"} Jun 14 20:27:47.596730 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:47.596706 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" event={"ID":"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e","Type":"ContainerStarted","Data":"cb77e31fffd18614cc3a8bdd6a4865199709b8970d46b4e11dcfb908692d2c0d"} Jun 14 20:27:47.672234 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:47.672136 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hhlth"] Jun 14 20:27:48.606774 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:48.606734 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hhlth" event={"ID":"27c35a0f-31c9-491a-8720-9d76dd19e483","Type":"ContainerStarted","Data":"7c60e1c008867d61a3864272c082f62fd9be88583cd5c8f22d496bccf98c6019"} Jun 14 20:27:52.623270 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:52.623211 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" event={"ID":"fcee1cdb-b049-499f-9b1d-9bf76eee3c2e","Type":"ContainerStarted","Data":"6b5fd639b0988b3685659857d684099e1173b1d4212aa2ca5d111eb1efeb4b3b"} Jun 14 20:27:52.624758 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:52.624730 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hhlth" event={"ID":"27c35a0f-31c9-491a-8720-9d76dd19e483","Type":"ContainerStarted","Data":"644e0df7e38d7ce7d831f9b051080ce1cfacc78afe760cd9fff0f9351ef7b122"} Jun 14 20:27:52.624894 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:52.624824 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:27:52.626026 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:52.626005 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" event={"ID":"ad0cbc31-cc53-4054-8546-0866e4661129","Type":"ContainerStarted","Data":"23d3731b955c2b39bd08da60d9a3acaf0eda58e868d3ea56bc98e94182cc1796"} Jun 14 20:27:52.626131 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:52.626120 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:27:52.642088 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:52.642043 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-686f9db88b-gntvx" podStartSLOduration=2.869466511 podStartE2EDuration="7.642029258s" totalImagesPullingTime="4.772562747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:27:52.64102169 +0000 UTC m=+581.425498281" watchObservedRunningTime="2026-06-14 20:27:52.642029258 +0000 UTC m=+581.426505923" Jun 14 20:27:52.657854 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:52.657809 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" podStartSLOduration=1.937728447 podStartE2EDuration="6.657780501s" totalImagesPullingTime="4.720052054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:27:52.656682621 +0000 UTC m=+581.441159212" watchObservedRunningTime="2026-06-14 20:27:52.657780501 +0000 UTC m=+581.442257092" Jun 14 20:27:52.677396 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:52.677352 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-hhlth" podStartSLOduration=2.52593703 podStartE2EDuration="6.677337452s" totalImagesPullingTime="4.151400422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:27:52.676755344 +0000 UTC m=+581.461231934" watchObservedRunningTime="2026-06-14 20:27:52.677337452 +0000 UTC m=+581.461814044" Jun 14 20:27:55.177639 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.177599 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6ztcm"] Jun 14 20:27:55.180952 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.180930 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:27:55.183392 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.183368 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 20:27:55.183477 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.183408 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bgdgm\"" Jun 14 20:27:55.185890 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.185869 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-944np"] Jun 14 20:27:55.189032 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.189015 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:27:55.192050 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.192032 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-spg6w\"" Jun 14 20:27:55.192140 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.192103 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 20:27:55.193147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.193122 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6ztcm"] Jun 14 20:27:55.202744 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.202717 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-944np"] Jun 14 20:27:55.267179 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.267144 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8f6442f-f86b-4202-b2fd-f95b9b3c19e1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-944np\" (UID: \"a8f6442f-f86b-4202-b2fd-f95b9b3c19e1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:27:55.267333 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.267191 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjzt5\" (UniqueName: \"kubernetes.io/projected/a8f6442f-f86b-4202-b2fd-f95b9b3c19e1-kube-api-access-bjzt5\") pod \"llmisvc-controller-manager-864bfd7bc9-944np\" (UID: \"a8f6442f-f86b-4202-b2fd-f95b9b3c19e1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:27:55.267333 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.267210 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbddeb7e-0485-4851-9047-60b14d7b5463-cert\") pod \"kserve-controller-manager-69fc866d76-6ztcm\" (UID: \"dbddeb7e-0485-4851-9047-60b14d7b5463\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:27:55.267333 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.267261 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kbbs\" (UniqueName: \"kubernetes.io/projected/dbddeb7e-0485-4851-9047-60b14d7b5463-kube-api-access-8kbbs\") pod \"kserve-controller-manager-69fc866d76-6ztcm\" (UID: \"dbddeb7e-0485-4851-9047-60b14d7b5463\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:27:55.367972 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.367938 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8f6442f-f86b-4202-b2fd-f95b9b3c19e1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-944np\" (UID: \"a8f6442f-f86b-4202-b2fd-f95b9b3c19e1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:27:55.368125 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.367983 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjzt5\" (UniqueName: \"kubernetes.io/projected/a8f6442f-f86b-4202-b2fd-f95b9b3c19e1-kube-api-access-bjzt5\") pod \"llmisvc-controller-manager-864bfd7bc9-944np\" (UID: \"a8f6442f-f86b-4202-b2fd-f95b9b3c19e1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:27:55.368125 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.368007 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbddeb7e-0485-4851-9047-60b14d7b5463-cert\") pod \"kserve-controller-manager-69fc866d76-6ztcm\" (UID: \"dbddeb7e-0485-4851-9047-60b14d7b5463\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:27:55.368125 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.368028 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kbbs\" (UniqueName: \"kubernetes.io/projected/dbddeb7e-0485-4851-9047-60b14d7b5463-kube-api-access-8kbbs\") pod \"kserve-controller-manager-69fc866d76-6ztcm\" (UID: \"dbddeb7e-0485-4851-9047-60b14d7b5463\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:27:55.370422 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.370398 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8f6442f-f86b-4202-b2fd-f95b9b3c19e1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-944np\" (UID: \"a8f6442f-f86b-4202-b2fd-f95b9b3c19e1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:27:55.370536 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.370468 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbddeb7e-0485-4851-9047-60b14d7b5463-cert\") pod \"kserve-controller-manager-69fc866d76-6ztcm\" (UID: \"dbddeb7e-0485-4851-9047-60b14d7b5463\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:27:55.387278 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.387241 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjzt5\" (UniqueName: \"kubernetes.io/projected/a8f6442f-f86b-4202-b2fd-f95b9b3c19e1-kube-api-access-bjzt5\") pod \"llmisvc-controller-manager-864bfd7bc9-944np\" (UID: \"a8f6442f-f86b-4202-b2fd-f95b9b3c19e1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:27:55.388660 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.388640 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kbbs\" (UniqueName: \"kubernetes.io/projected/dbddeb7e-0485-4851-9047-60b14d7b5463-kube-api-access-8kbbs\") pod \"kserve-controller-manager-69fc866d76-6ztcm\" (UID: \"dbddeb7e-0485-4851-9047-60b14d7b5463\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:27:55.491454 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.491424 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:27:55.500540 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.500517 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:27:55.636512 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.636379 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6ztcm"] Jun 14 20:27:55.638880 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:27:55.638841 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbddeb7e_0485_4851_9047_60b14d7b5463.slice/crio-2d3a6b637b4e47a6f1847a69d90423ef8388571e418cc5e26b2cade0c4a9f193 WatchSource:0}: Error finding container 2d3a6b637b4e47a6f1847a69d90423ef8388571e418cc5e26b2cade0c4a9f193: Status 404 returned error can't find the container with id 2d3a6b637b4e47a6f1847a69d90423ef8388571e418cc5e26b2cade0c4a9f193 Jun 14 20:27:55.656433 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:55.656307 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-944np"] Jun 14 20:27:55.658561 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:27:55.658529 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda8f6442f_f86b_4202_b2fd_f95b9b3c19e1.slice/crio-604d0cf7628ba71715c058b1ccc2657a3486f4eeda20ffcbed8cbd9bd9a5ce46 WatchSource:0}: Error finding container 604d0cf7628ba71715c058b1ccc2657a3486f4eeda20ffcbed8cbd9bd9a5ce46: Status 404 returned error can't find the container with id 604d0cf7628ba71715c058b1ccc2657a3486f4eeda20ffcbed8cbd9bd9a5ce46 Jun 14 20:27:56.644717 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:56.644637 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" event={"ID":"a8f6442f-f86b-4202-b2fd-f95b9b3c19e1","Type":"ContainerStarted","Data":"604d0cf7628ba71715c058b1ccc2657a3486f4eeda20ffcbed8cbd9bd9a5ce46"} Jun 14 20:27:56.649126 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:56.649090 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" event={"ID":"dbddeb7e-0485-4851-9047-60b14d7b5463","Type":"ContainerStarted","Data":"2d3a6b637b4e47a6f1847a69d90423ef8388571e418cc5e26b2cade0c4a9f193"} Jun 14 20:27:58.658208 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:58.658166 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" event={"ID":"dbddeb7e-0485-4851-9047-60b14d7b5463","Type":"ContainerStarted","Data":"8053cdfaaede0624f51d83daaacbf590caedd3d09a68ebf66a693abc199987af"} Jun 14 20:27:58.658609 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:58.658307 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:27:58.676371 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:58.676314 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" podStartSLOduration=0.856036993 podStartE2EDuration="3.676299074s" totalImagesPullingTime="2.820262081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:27:58.67424443 +0000 UTC m=+587.458721021" watchObservedRunningTime="2026-06-14 20:27:58.676299074 +0000 UTC m=+587.460775665" Jun 14 20:27:59.663406 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:59.663306 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" event={"ID":"a8f6442f-f86b-4202-b2fd-f95b9b3c19e1","Type":"ContainerStarted","Data":"b6432c383d382419b95ad54c3f7ccad999a32f581f10dc3e56f7b047f27f0989"} Jun 14 20:27:59.679608 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:27:59.679553 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" podStartSLOduration=0.991248907 podStartE2EDuration="4.6795391s" totalImagesPullingTime="3.688290193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:27:59.679046809 +0000 UTC m=+588.463523401" watchObservedRunningTime="2026-06-14 20:27:59.6795391 +0000 UTC m=+588.464015691" Jun 14 20:28:00.667362 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:00.667327 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:28:03.632436 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:03.632399 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-v8bwc" Jun 14 20:28:03.634341 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:03.634321 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-hhlth" Jun 14 20:28:04.889346 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:04.889306 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq"] Jun 14 20:28:04.892708 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:04.892691 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:04.895931 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:04.895906 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 14 20:28:04.896073 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:04.895942 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 14 20:28:04.896073 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:04.895990 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-mfzbw\"" Jun 14 20:28:04.910739 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:04.910710 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq"] Jun 14 20:28:04.962100 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:04.962066 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1bda2db2-dba0-4dc3-bfb0-a569b758836a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-w9xwq\" (UID: \"1bda2db2-dba0-4dc3-bfb0-a569b758836a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:04.962100 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:04.962105 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb8ql\" (UniqueName: \"kubernetes.io/projected/1bda2db2-dba0-4dc3-bfb0-a569b758836a-kube-api-access-sb8ql\") pod \"servicemesh-operator3-57f65f65fb-w9xwq\" (UID: \"1bda2db2-dba0-4dc3-bfb0-a569b758836a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:05.063403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:05.063365 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1bda2db2-dba0-4dc3-bfb0-a569b758836a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-w9xwq\" (UID: \"1bda2db2-dba0-4dc3-bfb0-a569b758836a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:05.063403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:05.063402 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb8ql\" (UniqueName: \"kubernetes.io/projected/1bda2db2-dba0-4dc3-bfb0-a569b758836a-kube-api-access-sb8ql\") pod \"servicemesh-operator3-57f65f65fb-w9xwq\" (UID: \"1bda2db2-dba0-4dc3-bfb0-a569b758836a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:05.066370 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:05.066343 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1bda2db2-dba0-4dc3-bfb0-a569b758836a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-w9xwq\" (UID: \"1bda2db2-dba0-4dc3-bfb0-a569b758836a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:05.075176 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:05.075150 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb8ql\" (UniqueName: \"kubernetes.io/projected/1bda2db2-dba0-4dc3-bfb0-a569b758836a-kube-api-access-sb8ql\") pod \"servicemesh-operator3-57f65f65fb-w9xwq\" (UID: \"1bda2db2-dba0-4dc3-bfb0-a569b758836a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:05.202420 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:05.202380 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:05.347434 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:05.347409 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq"] Jun 14 20:28:05.350214 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:28:05.350182 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bda2db2_dba0_4dc3_bfb0_a569b758836a.slice/crio-522b59702b1586279ad616bcbfef2199fa32f6a3bb9115aec5abb163fe1408e2 WatchSource:0}: Error finding container 522b59702b1586279ad616bcbfef2199fa32f6a3bb9115aec5abb163fe1408e2: Status 404 returned error can't find the container with id 522b59702b1586279ad616bcbfef2199fa32f6a3bb9115aec5abb163fe1408e2 Jun 14 20:28:05.690029 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:05.689941 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" event={"ID":"1bda2db2-dba0-4dc3-bfb0-a569b758836a","Type":"ContainerStarted","Data":"522b59702b1586279ad616bcbfef2199fa32f6a3bb9115aec5abb163fe1408e2"} Jun 14 20:28:08.703908 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:08.703871 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" event={"ID":"1bda2db2-dba0-4dc3-bfb0-a569b758836a","Type":"ContainerStarted","Data":"9a7c6edfc195ed03e6e90219b79ff622c2c41e7afb5d321baf0b68519941a315"} Jun 14 20:28:08.704286 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:08.703932 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:08.727502 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:08.727458 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" podStartSLOduration=2.4230092819999998 podStartE2EDuration="4.727437125s" totalImagesPullingTime="2.304427843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:28:08.725875449 +0000 UTC m=+597.510352051" watchObservedRunningTime="2026-06-14 20:28:08.727437125 +0000 UTC m=+597.511913719" Jun 14 20:28:11.600300 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:11.600197 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:28:11.618403 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:11.600460 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:28:12.903668 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:12.903635 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4"] Jun 14 20:28:12.906618 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:12.906601 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:12.909089 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:12.909059 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 20:28:12.909216 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:12.909093 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 20:28:12.909216 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:12.909190 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qpbdf\"" Jun 14 20:28:12.909336 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:12.909250 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 20:28:12.910198 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:12.910182 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 20:28:12.923788 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:12.923759 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4"] Jun 14 20:28:13.031392 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.031357 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.031558 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.031404 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62efdb13-f37e-4852-b6de-b5febc3d3c52-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.031558 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.031429 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7d4n\" (UniqueName: \"kubernetes.io/projected/62efdb13-f37e-4852-b6de-b5febc3d3c52-kube-api-access-z7d4n\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.031558 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.031472 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.031558 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.031493 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62efdb13-f37e-4852-b6de-b5febc3d3c52-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.031558 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.031526 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.031722 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.031569 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.132845 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.132792 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.133043 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.132860 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.133043 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.132908 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62efdb13-f37e-4852-b6de-b5febc3d3c52-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.133043 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.132936 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7d4n\" (UniqueName: \"kubernetes.io/projected/62efdb13-f37e-4852-b6de-b5febc3d3c52-kube-api-access-z7d4n\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.133043 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.132976 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.133043 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.133004 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62efdb13-f37e-4852-b6de-b5febc3d3c52-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.133043 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.133043 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.133503 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.133461 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.135426 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.135376 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.135426 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.135376 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.136148 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.135838 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62efdb13-f37e-4852-b6de-b5febc3d3c52-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.136148 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.136114 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62efdb13-f37e-4852-b6de-b5febc3d3c52-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.144613 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.144586 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62efdb13-f37e-4852-b6de-b5febc3d3c52-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.145103 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.145081 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7d4n\" (UniqueName: \"kubernetes.io/projected/62efdb13-f37e-4852-b6de-b5febc3d3c52-kube-api-access-z7d4n\") pod \"istiod-openshift-gateway-75c67f8887-2sbn4\" (UID: \"62efdb13-f37e-4852-b6de-b5febc3d3c52\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.225244 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.225202 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:13.360526 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.360489 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4"] Jun 14 20:28:13.363491 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:28:13.363464 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62efdb13_f37e_4852_b6de_b5febc3d3c52.slice/crio-aa5cf309131cd46c9de248306223b1086faf4311fd67ae0bfb1cead355e4b303 WatchSource:0}: Error finding container aa5cf309131cd46c9de248306223b1086faf4311fd67ae0bfb1cead355e4b303: Status 404 returned error can't find the container with id aa5cf309131cd46c9de248306223b1086faf4311fd67ae0bfb1cead355e4b303 Jun 14 20:28:13.726196 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:13.726161 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" event={"ID":"62efdb13-f37e-4852-b6de-b5febc3d3c52","Type":"ContainerStarted","Data":"aa5cf309131cd46c9de248306223b1086faf4311fd67ae0bfb1cead355e4b303"} Jun 14 20:28:15.786570 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:15.786537 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 14 20:28:15.786851 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:15.786602 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 14 20:28:16.740316 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:16.740281 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" event={"ID":"62efdb13-f37e-4852-b6de-b5febc3d3c52","Type":"ContainerStarted","Data":"18b52ff33add86c63e80b4c570eada45d3b5f0827313ca387fd795065c34c1fa"} Jun 14 20:28:16.740516 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:16.740472 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:16.742392 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:16.742364 2549 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-2sbn4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 14 20:28:16.742507 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:16.742419 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" podUID="62efdb13-f37e-4852-b6de-b5febc3d3c52" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:28:16.766328 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:16.766274 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" podStartSLOduration=2.345553994 podStartE2EDuration="4.766259025s" totalImagesPullingTime="2.420705031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:28:16.76454656 +0000 UTC m=+605.549023146" watchObservedRunningTime="2026-06-14 20:28:16.766259025 +0000 UTC m=+605.550735616" Jun 14 20:28:17.746283 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:17.746257 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2sbn4" Jun 14 20:28:19.711008 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:19.710976 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w9xwq" Jun 14 20:28:21.048419 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.048366 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5d5957fd7b-vcksc"] Jun 14 20:28:21.052211 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.052188 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" Jun 14 20:28:21.054770 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.054750 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5tg6w\"" Jun 14 20:28:21.054903 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.054882 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 20:28:21.073327 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.073303 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d5957fd7b-vcksc"] Jun 14 20:28:21.102026 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.102000 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d-redirect-config\") pod \"dashboard-redirect-5d5957fd7b-vcksc\" (UID: \"b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d\") " pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" Jun 14 20:28:21.102152 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.102084 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvm5n\" (UniqueName: \"kubernetes.io/projected/b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d-kube-api-access-wvm5n\") pod \"dashboard-redirect-5d5957fd7b-vcksc\" (UID: \"b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d\") " pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" Jun 14 20:28:21.203314 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.203284 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvm5n\" (UniqueName: \"kubernetes.io/projected/b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d-kube-api-access-wvm5n\") pod \"dashboard-redirect-5d5957fd7b-vcksc\" (UID: \"b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d\") " pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" Jun 14 20:28:21.203505 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.203358 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d-redirect-config\") pod \"dashboard-redirect-5d5957fd7b-vcksc\" (UID: \"b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d\") " pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" Jun 14 20:28:21.204111 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.204089 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d-redirect-config\") pod \"dashboard-redirect-5d5957fd7b-vcksc\" (UID: \"b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d\") " pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" Jun 14 20:28:21.214281 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.214255 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvm5n\" (UniqueName: \"kubernetes.io/projected/b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d-kube-api-access-wvm5n\") pod \"dashboard-redirect-5d5957fd7b-vcksc\" (UID: \"b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d\") " pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" Jun 14 20:28:21.362334 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.362246 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" Jun 14 20:28:21.489245 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.489221 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d5957fd7b-vcksc"] Jun 14 20:28:21.491916 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:28:21.491884 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e4a489_5ae5_46cb_bc41_3ee76ede8b5d.slice/crio-af8f5e2ccfb583be446c3cbd13ef83a6664e912b90514eb64c92e0175a97c3fc WatchSource:0}: Error finding container af8f5e2ccfb583be446c3cbd13ef83a6664e912b90514eb64c92e0175a97c3fc: Status 404 returned error can't find the container with id af8f5e2ccfb583be446c3cbd13ef83a6664e912b90514eb64c92e0175a97c3fc Jun 14 20:28:21.768694 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:21.768655 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" event={"ID":"b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d","Type":"ContainerStarted","Data":"af8f5e2ccfb583be446c3cbd13ef83a6664e912b90514eb64c92e0175a97c3fc"} Jun 14 20:28:23.779638 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:23.779600 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" event={"ID":"b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d","Type":"ContainerStarted","Data":"39056bdc538d59c19658aff6b0f5fb699e5fefe2072c4cfc7671280af20ac4e4"} Jun 14 20:28:23.795558 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:23.795510 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5d5957fd7b-vcksc" podStartSLOduration=0.882000948 podStartE2EDuration="2.795494126s" totalImagesPullingTime="1.913493178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:28:23.793791194 +0000 UTC m=+612.578267787" watchObservedRunningTime="2026-06-14 20:28:23.795494126 +0000 UTC m=+612.579970717" Jun 14 20:28:29.668658 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:29.668624 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6ztcm" Jun 14 20:28:31.672708 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:28:31.672676 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-944np" Jun 14 20:29:19.501119 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.501078 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4"] Jun 14 20:29:19.512049 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.512022 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:19.512548 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.512514 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4"] Jun 14 20:29:19.514749 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.514538 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 20:29:19.515697 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.515656 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 20:29:19.515820 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.515696 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8q5wp\"" Jun 14 20:29:19.576161 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.576130 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr72q\" (UniqueName: \"kubernetes.io/projected/9c101418-51e1-4a8d-84f8-ec972b2cf523-kube-api-access-pr72q\") pod \"limitador-operator-controller-manager-859d7b78bd-g87t4\" (UID: \"9c101418-51e1-4a8d-84f8-ec972b2cf523\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:19.676966 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.676935 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr72q\" (UniqueName: \"kubernetes.io/projected/9c101418-51e1-4a8d-84f8-ec972b2cf523-kube-api-access-pr72q\") pod \"limitador-operator-controller-manager-859d7b78bd-g87t4\" (UID: \"9c101418-51e1-4a8d-84f8-ec972b2cf523\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:19.685505 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.685481 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr72q\" (UniqueName: \"kubernetes.io/projected/9c101418-51e1-4a8d-84f8-ec972b2cf523-kube-api-access-pr72q\") pod \"limitador-operator-controller-manager-859d7b78bd-g87t4\" (UID: \"9c101418-51e1-4a8d-84f8-ec972b2cf523\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:19.823575 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.823525 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:19.950191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:19.950166 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4"] Jun 14 20:29:19.952727 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:29:19.952689 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c101418_51e1_4a8d_84f8_ec972b2cf523.slice/crio-37ca904cfd67d163e137af9688f2ee6ec62e592bbd1e4873c11dee819e24ebe4 WatchSource:0}: Error finding container 37ca904cfd67d163e137af9688f2ee6ec62e592bbd1e4873c11dee819e24ebe4: Status 404 returned error can't find the container with id 37ca904cfd67d163e137af9688f2ee6ec62e592bbd1e4873c11dee819e24ebe4 Jun 14 20:29:20.041386 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:20.041360 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" event={"ID":"9c101418-51e1-4a8d-84f8-ec972b2cf523","Type":"ContainerStarted","Data":"37ca904cfd67d163e137af9688f2ee6ec62e592bbd1e4873c11dee819e24ebe4"} Jun 14 20:29:22.053408 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:22.053325 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" event={"ID":"9c101418-51e1-4a8d-84f8-ec972b2cf523","Type":"ContainerStarted","Data":"1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9"} Jun 14 20:29:22.053761 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:22.053428 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:22.067635 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:22.067527 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" podStartSLOduration=1.256053305 podStartE2EDuration="3.067509089s" totalImagesPullingTime="1.811455784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:29:22.06748713 +0000 UTC m=+670.851963722" watchObservedRunningTime="2026-06-14 20:29:22.067509089 +0000 UTC m=+670.851985681" Jun 14 20:29:33.060146 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:33.060117 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:36.393965 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.393926 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4"] Jun 14 20:29:36.394427 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.394187 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" podUID="9c101418-51e1-4a8d-84f8-ec972b2cf523" containerName="manager" containerID="cri-o://1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9" gracePeriod=2 Jun 14 20:29:36.408050 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:29:36.408006 2549 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c101418-51e1-4a8d-84f8-ec972b2cf523\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-g87t4\": pods \"limitador-operator-controller-manager-859d7b78bd-g87t4\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:36.408809 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.408733 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4"] Jun 14 20:29:36.641265 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.641241 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:36.643473 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:29:36.643446 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g87t4\" is forbidden: User \"system:node:ip-10-0-132-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-94.ec2.internal' and this object" podUID="9c101418-51e1-4a8d-84f8-ec972b2cf523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:36.674596 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.674529 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48"] Jun 14 20:29:36.674868 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.674855 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c101418-51e1-4a8d-84f8-ec972b2cf523" containerName="manager" Jun 14 20:29:36.674920 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.674870 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c101418-51e1-4a8d-84f8-ec972b2cf523" containerName="manager" Jun 14 20:29:36.674954 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.674923 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c101418-51e1-4a8d-84f8-ec972b2cf523" containerName="manager" Jun 14 20:29:36.677830 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.677785 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:29:36.680367 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.680347 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ffz2q\"" Jun 14 20:29:36.692335 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.692310 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48"] Jun 14 20:29:36.695427 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.695408 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr72q\" (UniqueName: \"kubernetes.io/projected/9c101418-51e1-4a8d-84f8-ec972b2cf523-kube-api-access-pr72q\") pod \"9c101418-51e1-4a8d-84f8-ec972b2cf523\" (UID: \"9c101418-51e1-4a8d-84f8-ec972b2cf523\") " Jun 14 20:29:36.695553 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.695536 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srz44\" (UniqueName: \"kubernetes.io/projected/a1e078ff-099e-4f44-aab9-85fc5fbe791e-kube-api-access-srz44\") pod \"kuadrant-operator-controller-manager-86878c769f-thb48\" (UID: \"a1e078ff-099e-4f44-aab9-85fc5fbe791e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:29:36.695622 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.695611 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1e078ff-099e-4f44-aab9-85fc5fbe791e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-thb48\" (UID: \"a1e078ff-099e-4f44-aab9-85fc5fbe791e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:29:36.697650 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.697622 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c101418-51e1-4a8d-84f8-ec972b2cf523-kube-api-access-pr72q" (OuterVolumeSpecName: "kube-api-access-pr72q") pod "9c101418-51e1-4a8d-84f8-ec972b2cf523" (UID: "9c101418-51e1-4a8d-84f8-ec972b2cf523"). InnerVolumeSpecName "kube-api-access-pr72q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:29:36.715265 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:29:36.715224 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g87t4\" is forbidden: User \"system:node:ip-10-0-132-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-94.ec2.internal' and this object" podUID="9c101418-51e1-4a8d-84f8-ec972b2cf523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:36.795986 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.795949 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srz44\" (UniqueName: \"kubernetes.io/projected/a1e078ff-099e-4f44-aab9-85fc5fbe791e-kube-api-access-srz44\") pod \"kuadrant-operator-controller-manager-86878c769f-thb48\" (UID: \"a1e078ff-099e-4f44-aab9-85fc5fbe791e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:29:36.796154 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.796025 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1e078ff-099e-4f44-aab9-85fc5fbe791e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-thb48\" (UID: \"a1e078ff-099e-4f44-aab9-85fc5fbe791e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:29:36.796154 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.796052 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr72q\" (UniqueName: \"kubernetes.io/projected/9c101418-51e1-4a8d-84f8-ec972b2cf523-kube-api-access-pr72q\") on node \"ip-10-0-132-94.ec2.internal\" DevicePath \"\"" Jun 14 20:29:36.796376 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.796361 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1e078ff-099e-4f44-aab9-85fc5fbe791e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-thb48\" (UID: \"a1e078ff-099e-4f44-aab9-85fc5fbe791e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:29:36.804856 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.804820 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srz44\" (UniqueName: \"kubernetes.io/projected/a1e078ff-099e-4f44-aab9-85fc5fbe791e-kube-api-access-srz44\") pod \"kuadrant-operator-controller-manager-86878c769f-thb48\" (UID: \"a1e078ff-099e-4f44-aab9-85fc5fbe791e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:29:36.988159 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:36.988116 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:29:37.122517 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:37.122492 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48"] Jun 14 20:29:37.128647 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:29:37.126190 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e078ff_099e_4f44_aab9_85fc5fbe791e.slice/crio-fe116f09a02454cf20ea96fc089e0b5ee16d94281ce49d417bd691b9b70d084d WatchSource:0}: Error finding container fe116f09a02454cf20ea96fc089e0b5ee16d94281ce49d417bd691b9b70d084d: Status 404 returned error can't find the container with id fe116f09a02454cf20ea96fc089e0b5ee16d94281ce49d417bd691b9b70d084d Jun 14 20:29:37.129686 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:37.129655 2549 generic.go:356] "Generic (PLEG): container finished" podID="9c101418-51e1-4a8d-84f8-ec972b2cf523" containerID="1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9" exitCode=0 Jun 14 20:29:37.129818 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:37.129707 2549 scope.go:117] "RemoveContainer" containerID="1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9" Jun 14 20:29:37.129818 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:37.129768 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:37.132163 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:29:37.132137 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g87t4\" is forbidden: User \"system:node:ip-10-0-132-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-94.ec2.internal' and this object" podUID="9c101418-51e1-4a8d-84f8-ec972b2cf523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:37.138555 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:37.138533 2549 scope.go:117] "RemoveContainer" containerID="1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9" Jun 14 20:29:37.138854 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:29:37.138833 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9\": container with ID starting with 1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9 not found: ID does not exist" containerID="1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9" Jun 14 20:29:37.138946 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:37.138862 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9"} err="failed to get container status \"1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9\": rpc error: code = NotFound desc = could not find container \"1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9\": container with ID starting with 1d7ce0e826ee12f6997293233fa990b1f55af37099565c91e9d11e4995ab0bd9 not found: ID does not exist" Jun 14 20:29:37.141923 ip-10-0-132-94 kubenswrapper[2549]: E0614 20:29:37.141897 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g87t4\" is forbidden: User \"system:node:ip-10-0-132-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-94.ec2.internal' and this object" podUID="9c101418-51e1-4a8d-84f8-ec972b2cf523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g87t4" Jun 14 20:29:37.621811 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:37.621760 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c101418-51e1-4a8d-84f8-ec972b2cf523" path="/var/lib/kubelet/pods/9c101418-51e1-4a8d-84f8-ec972b2cf523/volumes" Jun 14 20:29:38.139252 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:38.139172 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" event={"ID":"a1e078ff-099e-4f44-aab9-85fc5fbe791e","Type":"ContainerStarted","Data":"fe116f09a02454cf20ea96fc089e0b5ee16d94281ce49d417bd691b9b70d084d"} Jun 14 20:29:42.162462 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:42.162430 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" event={"ID":"a1e078ff-099e-4f44-aab9-85fc5fbe791e","Type":"ContainerStarted","Data":"478d0d890b0ab1dfba961c9c728d2aba1d70b3d0b8fd4b416eacbcabe6a6a9e8"} Jun 14 20:29:42.162885 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:42.162572 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:29:42.181191 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:42.181037 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" podStartSLOduration=1.8898190019999999 podStartE2EDuration="6.181020182s" totalImagesPullingTime="4.29120118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:29:42.179927436 +0000 UTC m=+690.964404028" watchObservedRunningTime="2026-06-14 20:29:42.181020182 +0000 UTC m=+690.965496773" Jun 14 20:29:53.169862 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:29:53.169829 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-thb48" Jun 14 20:30:11.389044 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.389012 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:30:11.394671 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.394653 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:30:11.397586 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.397563 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nf6l4\"" Jun 14 20:30:11.397982 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.397962 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 20:30:11.399041 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.399018 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:30:11.429481 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.429456 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:30:11.483279 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.483249 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd499\" (UniqueName: \"kubernetes.io/projected/045f8d23-7cbd-47a3-bafa-5b2ca0c79134-kube-api-access-bd499\") pod \"limitador-limitador-54d6d988d5-vmdjx\" (UID: \"045f8d23-7cbd-47a3-bafa-5b2ca0c79134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:30:11.483372 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.483284 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/045f8d23-7cbd-47a3-bafa-5b2ca0c79134-config-file\") pod \"limitador-limitador-54d6d988d5-vmdjx\" (UID: \"045f8d23-7cbd-47a3-bafa-5b2ca0c79134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:30:11.584330 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.584299 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd499\" (UniqueName: \"kubernetes.io/projected/045f8d23-7cbd-47a3-bafa-5b2ca0c79134-kube-api-access-bd499\") pod \"limitador-limitador-54d6d988d5-vmdjx\" (UID: \"045f8d23-7cbd-47a3-bafa-5b2ca0c79134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:30:11.584330 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.584331 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/045f8d23-7cbd-47a3-bafa-5b2ca0c79134-config-file\") pod \"limitador-limitador-54d6d988d5-vmdjx\" (UID: \"045f8d23-7cbd-47a3-bafa-5b2ca0c79134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:30:11.586915 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.586895 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 20:30:11.592146 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.592115 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd499\" (UniqueName: \"kubernetes.io/projected/045f8d23-7cbd-47a3-bafa-5b2ca0c79134-kube-api-access-bd499\") pod \"limitador-limitador-54d6d988d5-vmdjx\" (UID: \"045f8d23-7cbd-47a3-bafa-5b2ca0c79134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:30:11.595097 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.595080 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/045f8d23-7cbd-47a3-bafa-5b2ca0c79134-config-file\") pod \"limitador-limitador-54d6d988d5-vmdjx\" (UID: \"045f8d23-7cbd-47a3-bafa-5b2ca0c79134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:30:11.708440 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.708414 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nf6l4\"" Jun 14 20:30:11.716466 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.716445 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:30:11.865945 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:11.865920 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:30:11.868335 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:30:11.868299 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045f8d23_7cbd_47a3_bafa_5b2ca0c79134.slice/crio-eb011042bebbe88696095e819f193d316353a6a72bc8f0103311061bcf3e9843 WatchSource:0}: Error finding container eb011042bebbe88696095e819f193d316353a6a72bc8f0103311061bcf3e9843: Status 404 returned error can't find the container with id eb011042bebbe88696095e819f193d316353a6a72bc8f0103311061bcf3e9843 Jun 14 20:30:12.304252 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:12.304215 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" event={"ID":"045f8d23-7cbd-47a3-bafa-5b2ca0c79134","Type":"ContainerStarted","Data":"eb011042bebbe88696095e819f193d316353a6a72bc8f0103311061bcf3e9843"} Jun 14 20:30:15.320009 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:15.319967 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" event={"ID":"045f8d23-7cbd-47a3-bafa-5b2ca0c79134","Type":"ContainerStarted","Data":"b269365ec433be4b9215427022566ac521cb30c3060038bad1ec14fa5afffb01"} Jun 14 20:30:15.320399 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:15.320089 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:30:15.338105 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:15.338050 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" podStartSLOduration=1.714293258 podStartE2EDuration="4.338033122s" totalImagesPullingTime="2.623739864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:30:15.336180499 +0000 UTC m=+724.120657099" watchObservedRunningTime="2026-06-14 20:30:15.338033122 +0000 UTC m=+724.122509762" Jun 14 20:30:26.325048 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:30:26.325009 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vmdjx" Jun 14 20:32:17.813502 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.813460 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-585bd99f8d-fff9s"] Jun 14 20:32:17.816909 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.816885 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:17.819217 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.819189 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 20:32:17.819347 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.819329 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5nfmt\"" Jun 14 20:32:17.826466 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.826441 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-585bd99f8d-fff9s"] Jun 14 20:32:17.845463 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.845438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51255783-640a-46dc-9c6c-b4ae236bee5f-maas-api-tls\") pod \"maas-api-585bd99f8d-fff9s\" (UID: \"51255783-640a-46dc-9c6c-b4ae236bee5f\") " pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:17.845557 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.845476 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccvh\" (UniqueName: \"kubernetes.io/projected/51255783-640a-46dc-9c6c-b4ae236bee5f-kube-api-access-lccvh\") pod \"maas-api-585bd99f8d-fff9s\" (UID: \"51255783-640a-46dc-9c6c-b4ae236bee5f\") " pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:17.845557 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.845529 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51255783-640a-46dc-9c6c-b4ae236bee5f-openshift-service-ca\") pod \"maas-api-585bd99f8d-fff9s\" (UID: \"51255783-640a-46dc-9c6c-b4ae236bee5f\") " pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:17.946453 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.946417 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51255783-640a-46dc-9c6c-b4ae236bee5f-openshift-service-ca\") pod \"maas-api-585bd99f8d-fff9s\" (UID: \"51255783-640a-46dc-9c6c-b4ae236bee5f\") " pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:17.946643 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.946523 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51255783-640a-46dc-9c6c-b4ae236bee5f-maas-api-tls\") pod \"maas-api-585bd99f8d-fff9s\" (UID: \"51255783-640a-46dc-9c6c-b4ae236bee5f\") " pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:17.946643 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.946568 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lccvh\" (UniqueName: \"kubernetes.io/projected/51255783-640a-46dc-9c6c-b4ae236bee5f-kube-api-access-lccvh\") pod \"maas-api-585bd99f8d-fff9s\" (UID: \"51255783-640a-46dc-9c6c-b4ae236bee5f\") " pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:17.947107 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.947084 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51255783-640a-46dc-9c6c-b4ae236bee5f-openshift-service-ca\") pod \"maas-api-585bd99f8d-fff9s\" (UID: \"51255783-640a-46dc-9c6c-b4ae236bee5f\") " pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:17.948932 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.948913 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51255783-640a-46dc-9c6c-b4ae236bee5f-maas-api-tls\") pod \"maas-api-585bd99f8d-fff9s\" (UID: \"51255783-640a-46dc-9c6c-b4ae236bee5f\") " pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:17.954701 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:17.954679 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccvh\" (UniqueName: \"kubernetes.io/projected/51255783-640a-46dc-9c6c-b4ae236bee5f-kube-api-access-lccvh\") pod \"maas-api-585bd99f8d-fff9s\" (UID: \"51255783-640a-46dc-9c6c-b4ae236bee5f\") " pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:18.128299 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:18.128217 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:18.267426 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:18.267395 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-585bd99f8d-fff9s"] Jun 14 20:32:18.271444 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:32:18.271417 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51255783_640a_46dc_9c6c_b4ae236bee5f.slice/crio-42e7877a04f41f34732ed6947daf22fa5fadd6e0d308f69d61ecd3918a095eed WatchSource:0}: Error finding container 42e7877a04f41f34732ed6947daf22fa5fadd6e0d308f69d61ecd3918a095eed: Status 404 returned error can't find the container with id 42e7877a04f41f34732ed6947daf22fa5fadd6e0d308f69d61ecd3918a095eed Jun 14 20:32:18.384217 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:18.384137 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:32:18.885831 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:18.885777 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-585bd99f8d-fff9s" event={"ID":"51255783-640a-46dc-9c6c-b4ae236bee5f","Type":"ContainerStarted","Data":"42e7877a04f41f34732ed6947daf22fa5fadd6e0d308f69d61ecd3918a095eed"} Jun 14 20:32:20.897437 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:20.897402 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-585bd99f8d-fff9s" event={"ID":"51255783-640a-46dc-9c6c-b4ae236bee5f","Type":"ContainerStarted","Data":"0dd10b79cf08782f91d01f3478fe46b0ee160236415921727fa487be4bd0de89"} Jun 14 20:32:20.898160 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:20.897528 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:32:20.914954 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:20.914911 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-585bd99f8d-fff9s" podStartSLOduration=2.105654447 podStartE2EDuration="3.914895429s" totalImagesPullingTime="1.809240982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:32:20.912623464 +0000 UTC m=+849.697100057" watchObservedRunningTime="2026-06-14 20:32:20.914895429 +0000 UTC m=+849.699372020" Jun 14 20:32:26.906991 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:32:26.906962 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-585bd99f8d-fff9s" Jun 14 20:33:11.627899 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:11.627787 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:33:11.629880 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:11.629855 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:33:18.101378 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.101346 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p"] Jun 14 20:33:18.103737 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.103710 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.107610 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.107536 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5jsvk\"" Jun 14 20:33:18.107610 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.107584 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 20:33:18.107838 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.107584 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 14 20:33:18.107838 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.107706 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 20:33:18.117310 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.117290 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p"] Jun 14 20:33:18.148945 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.148915 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.148945 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.148958 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.149168 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.148983 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.149168 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.149061 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4dced2d-1849-4c5f-9c39-d8d9052098aa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.149168 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.149128 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9n7b\" (UniqueName: \"kubernetes.io/projected/e4dced2d-1849-4c5f-9c39-d8d9052098aa-kube-api-access-b9n7b\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.149168 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.149158 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.250479 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.250447 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.250479 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.250488 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.250724 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.250504 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.250724 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.250526 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4dced2d-1849-4c5f-9c39-d8d9052098aa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.250724 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.250572 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9n7b\" (UniqueName: \"kubernetes.io/projected/e4dced2d-1849-4c5f-9c39-d8d9052098aa-kube-api-access-b9n7b\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.250724 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.250601 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.250962 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.250938 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.251058 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.251035 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.251119 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.251058 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.252910 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.252885 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4dced2d-1849-4c5f-9c39-d8d9052098aa-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.253173 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.253148 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4dced2d-1849-4c5f-9c39-d8d9052098aa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.257977 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.257954 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9n7b\" (UniqueName: \"kubernetes.io/projected/e4dced2d-1849-4c5f-9c39-d8d9052098aa-kube-api-access-b9n7b\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p\" (UID: \"e4dced2d-1849-4c5f-9c39-d8d9052098aa\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.417084 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.417006 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:18.512885 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.512851 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:33:18.547038 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.546506 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p"] Jun 14 20:33:18.549121 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:33:18.549089 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4dced2d_1849_4c5f_9c39_d8d9052098aa.slice/crio-eac987e545b91bc360046df6ab8b86d3e14073aac7b82923d0920d9e2bdf56cb WatchSource:0}: Error finding container eac987e545b91bc360046df6ab8b86d3e14073aac7b82923d0920d9e2bdf56cb: Status 404 returned error can't find the container with id eac987e545b91bc360046df6ab8b86d3e14073aac7b82923d0920d9e2bdf56cb Jun 14 20:33:18.551326 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:18.551305 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 20:33:19.165175 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:19.165139 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" event={"ID":"e4dced2d-1849-4c5f-9c39-d8d9052098aa","Type":"ContainerStarted","Data":"eac987e545b91bc360046df6ab8b86d3e14073aac7b82923d0920d9e2bdf56cb"} Jun 14 20:33:23.186956 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:23.186922 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" event={"ID":"e4dced2d-1849-4c5f-9c39-d8d9052098aa","Type":"ContainerStarted","Data":"384f6af312a9a8c5e2353e4cef2378f628519d822eff4d25c2ac5871acc53eb8"} Jun 14 20:33:23.904402 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:23.904325 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:33:24.193099 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:24.193022 2549 generic.go:356] "Generic (PLEG): container finished" podID="e4dced2d-1849-4c5f-9c39-d8d9052098aa" containerID="384f6af312a9a8c5e2353e4cef2378f628519d822eff4d25c2ac5871acc53eb8" exitCode=0 Jun 14 20:33:24.193099 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:24.193085 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" event={"ID":"e4dced2d-1849-4c5f-9c39-d8d9052098aa","Type":"ContainerDied","Data":"384f6af312a9a8c5e2353e4cef2378f628519d822eff4d25c2ac5871acc53eb8"} Jun 14 20:33:26.204713 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:26.204673 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" event={"ID":"e4dced2d-1849-4c5f-9c39-d8d9052098aa","Type":"ContainerStarted","Data":"2bba0e968762c1ff4334f47fc35be9c4008e1a2c07cd308867015b00382adec7"} Jun 14 20:33:26.224293 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:26.224243 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" podStartSLOduration=2.093274278 podStartE2EDuration="8.224226503s" totalImagesPullingTime="4.867542914s" totalInitContainerRuntime="1.263409311s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:33:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:33:26.222655061 +0000 UTC m=+915.007131653" watchObservedRunningTime="2026-06-14 20:33:26.224226503 +0000 UTC m=+915.008703075" Jun 14 20:33:27.405351 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.405316 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp"] Jun 14 20:33:27.409859 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.409838 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.412500 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.412480 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 14 20:33:27.418095 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.418074 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp"] Jun 14 20:33:27.534609 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.534577 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a58010ea-c19c-486a-bc4e-29317e9c6082-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.534751 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.534617 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.534751 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.534671 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9bjx\" (UniqueName: \"kubernetes.io/projected/a58010ea-c19c-486a-bc4e-29317e9c6082-kube-api-access-g9bjx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.534890 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.534788 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.534890 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.534841 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.534890 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.534863 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.635284 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.635255 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.635284 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.635285 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.635489 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.635308 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.635489 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.635343 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a58010ea-c19c-486a-bc4e-29317e9c6082-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.635489 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.635373 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.635489 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.635414 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9bjx\" (UniqueName: \"kubernetes.io/projected/a58010ea-c19c-486a-bc4e-29317e9c6082-kube-api-access-g9bjx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.635741 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.635707 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.635870 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.635746 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.635870 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.635766 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.637659 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.637641 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a58010ea-c19c-486a-bc4e-29317e9c6082-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.637755 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.637739 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a58010ea-c19c-486a-bc4e-29317e9c6082-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.642714 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.642689 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9bjx\" (UniqueName: \"kubernetes.io/projected/a58010ea-c19c-486a-bc4e-29317e9c6082-kube-api-access-g9bjx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp\" (UID: \"a58010ea-c19c-486a-bc4e-29317e9c6082\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.721342 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.721318 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:33:27.848199 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:27.848170 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp"] Jun 14 20:33:27.849719 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:33:27.849692 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58010ea_c19c_486a_bc4e_29317e9c6082.slice/crio-0b8ba3f368c2e616b70a8a250c5c124cf1aad8b96a58da20b2296a626126b3e0 WatchSource:0}: Error finding container 0b8ba3f368c2e616b70a8a250c5c124cf1aad8b96a58da20b2296a626126b3e0: Status 404 returned error can't find the container with id 0b8ba3f368c2e616b70a8a250c5c124cf1aad8b96a58da20b2296a626126b3e0 Jun 14 20:33:28.104550 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:28.104472 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:33:28.215427 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:28.215392 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" event={"ID":"a58010ea-c19c-486a-bc4e-29317e9c6082","Type":"ContainerStarted","Data":"10e2c47cdfd8be6e7e34e6bc08c998a8de1d3e0bd3467b5eef9b5468e0d30bd7"} Jun 14 20:33:28.215569 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:28.215453 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" event={"ID":"a58010ea-c19c-486a-bc4e-29317e9c6082","Type":"ContainerStarted","Data":"0b8ba3f368c2e616b70a8a250c5c124cf1aad8b96a58da20b2296a626126b3e0"} Jun 14 20:33:28.418078 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:28.417995 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:28.418078 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:28.418056 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:28.429954 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:28.429927 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:29.230751 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:29.230705 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p" Jun 14 20:33:37.706838 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:37.706778 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:33:51.401223 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:51.401180 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:33:53.703819 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.703776 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh"] Jun 14 20:33:53.723820 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.723768 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh"] Jun 14 20:33:53.723981 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.723892 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.726375 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.726351 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 14 20:33:53.862718 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.862687 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd6641a0-0dd5-4ea6-9373-506221ea50f7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.862718 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.862720 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.862986 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.862748 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.862986 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.862765 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.862986 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.862875 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.862986 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.862897 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72hvk\" (UniqueName: \"kubernetes.io/projected/cd6641a0-0dd5-4ea6-9373-506221ea50f7-kube-api-access-72hvk\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.963709 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.963627 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.963709 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.963665 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.963709 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.963683 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.963982 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.963745 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.963982 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.963769 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72hvk\" (UniqueName: \"kubernetes.io/projected/cd6641a0-0dd5-4ea6-9373-506221ea50f7-kube-api-access-72hvk\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.963982 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.963840 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd6641a0-0dd5-4ea6-9373-506221ea50f7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.964164 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.964129 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.964164 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.964150 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.964282 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.964216 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.966436 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.966414 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd6641a0-0dd5-4ea6-9373-506221ea50f7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.966559 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.966421 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd6641a0-0dd5-4ea6-9373-506221ea50f7-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:53.971053 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:53.971035 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72hvk\" (UniqueName: \"kubernetes.io/projected/cd6641a0-0dd5-4ea6-9373-506221ea50f7-kube-api-access-72hvk\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gfpsh\" (UID: \"cd6641a0-0dd5-4ea6-9373-506221ea50f7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:54.035007 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:54.034973 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:33:54.169779 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:54.169754 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh"] Jun 14 20:33:54.172186 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:33:54.172159 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6641a0_0dd5_4ea6_9373_506221ea50f7.slice/crio-b453e34994331e3d2d1dfea7c2e4f05e8f034f048b0f43139fa553feb9a77f2c WatchSource:0}: Error finding container b453e34994331e3d2d1dfea7c2e4f05e8f034f048b0f43139fa553feb9a77f2c: Status 404 returned error can't find the container with id b453e34994331e3d2d1dfea7c2e4f05e8f034f048b0f43139fa553feb9a77f2c Jun 14 20:33:54.333101 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:54.333063 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" event={"ID":"cd6641a0-0dd5-4ea6-9373-506221ea50f7","Type":"ContainerStarted","Data":"0336c84f2060618a30870aa794f94b7c740ffee73aa4b1b81d96a6dbd9e504ff"} Jun 14 20:33:54.333101 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:54.333105 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" event={"ID":"cd6641a0-0dd5-4ea6-9373-506221ea50f7","Type":"ContainerStarted","Data":"b453e34994331e3d2d1dfea7c2e4f05e8f034f048b0f43139fa553feb9a77f2c"} Jun 14 20:33:55.001938 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:55.001903 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vmdjx"] Jun 14 20:33:56.344130 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:56.344097 2549 generic.go:356] "Generic (PLEG): container finished" podID="cd6641a0-0dd5-4ea6-9373-506221ea50f7" containerID="0336c84f2060618a30870aa794f94b7c740ffee73aa4b1b81d96a6dbd9e504ff" exitCode=0 Jun 14 20:33:56.344504 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:56.344176 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" event={"ID":"cd6641a0-0dd5-4ea6-9373-506221ea50f7","Type":"ContainerDied","Data":"0336c84f2060618a30870aa794f94b7c740ffee73aa4b1b81d96a6dbd9e504ff"} Jun 14 20:33:57.351410 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:57.351376 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" event={"ID":"cd6641a0-0dd5-4ea6-9373-506221ea50f7","Type":"ContainerStarted","Data":"cbccfa4f304a62750c58374fede86000d142568a6fa9c53a66d615c4a2011bb5"} Jun 14 20:33:57.369892 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:33:57.369833 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" podStartSLOduration=2.983984145 podStartE2EDuration="4.369811658s" totalImagesPullingTime="155.01733ms" totalInitContainerRuntime="1.230810183s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:33:57.368941754 +0000 UTC m=+946.153418346" watchObservedRunningTime="2026-06-14 20:33:57.369811658 +0000 UTC m=+946.154288248" Jun 14 20:34:04.035568 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:04.035527 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:34:04.036083 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:04.035848 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:34:04.048718 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:04.048694 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:34:04.397180 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:04.397088 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gfpsh" Jun 14 20:34:22.468974 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:22.468938 2549 generic.go:356] "Generic (PLEG): container finished" podID="a58010ea-c19c-486a-bc4e-29317e9c6082" containerID="10e2c47cdfd8be6e7e34e6bc08c998a8de1d3e0bd3467b5eef9b5468e0d30bd7" exitCode=0 Jun 14 20:34:22.469541 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:22.469013 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" event={"ID":"a58010ea-c19c-486a-bc4e-29317e9c6082","Type":"ContainerDied","Data":"10e2c47cdfd8be6e7e34e6bc08c998a8de1d3e0bd3467b5eef9b5468e0d30bd7"} Jun 14 20:34:23.475111 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:23.475067 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" event={"ID":"a58010ea-c19c-486a-bc4e-29317e9c6082","Type":"ContainerStarted","Data":"798cad2ffd0a4df09bb89c759a2d2b120c1568947bd814c37d79026c1c7a6e31"} Jun 14 20:34:23.498078 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:23.498015 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" podStartSLOduration=2.327690997 podStartE2EDuration="56.497999548s" totalImagesPullingTime="184.436201ms" totalInitContainerRuntime="53.98587235s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:34:23.495588111 +0000 UTC m=+972.280064703" watchObservedRunningTime="2026-06-14 20:34:23.497999548 +0000 UTC m=+972.282476138" Jun 14 20:34:27.722379 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:27.722346 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:34:27.722818 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:27.722398 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:34:27.734791 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:27.734765 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:34:28.508310 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:34:28.508283 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp" Jun 14 20:35:51.300559 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:51.300509 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d5957fd7b-vcksc_b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d/nginx/0.log" Jun 14 20:35:51.398549 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:51.398519 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6ztcm_dbddeb7e-0485-4851-9047-60b14d7b5463/manager/0.log" Jun 14 20:35:51.508936 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:51.508902 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-944np_a8f6442f-f86b-4202-b2fd-f95b9b3c19e1/manager/0.log" Jun 14 20:35:51.617650 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:51.617559 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-585bd99f8d-fff9s_51255783-640a-46dc-9c6c-b4ae236bee5f/maas-api/0.log" Jun 14 20:35:51.832593 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:51.832564 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hhlth_27c35a0f-31c9-491a-8720-9d76dd19e483/server/0.log" Jun 14 20:35:51.953327 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:51.953277 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-v8bwc_ad0cbc31-cc53-4054-8546-0866e4661129/manager/0.log" Jun 14 20:35:52.053321 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:52.053291 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cf7969f6-nt8ft_8809b44c-9fb1-40b9-b314-a5a0255c704c/copy-manifests/0.log" Jun 14 20:35:52.058125 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:52.058105 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cf7969f6-nt8ft_8809b44c-9fb1-40b9-b314-a5a0255c704c/manager/0.log" Jun 14 20:35:54.101770 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:54.101741 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-thb48_a1e078ff-099e-4f44-aab9-85fc5fbe791e/manager/0.log" Jun 14 20:35:54.206273 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:54.206250 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vmdjx_045f8d23-7cbd-47a3-bafa-5b2ca0c79134/limitador/0.log" Jun 14 20:35:54.749605 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:54.749560 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2sbn4_62efdb13-f37e-4852-b6de-b5febc3d3c52/discovery/0.log" Jun 14 20:35:54.957387 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:54.957351 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-gntvx_fcee1cdb-b049-499f-9b1d-9bf76eee3c2e/kube-auth-proxy/0.log" Jun 14 20:35:55.677707 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:55.677681 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p_e4dced2d-1849-4c5f-9c39-d8d9052098aa/storage-initializer/0.log" Jun 14 20:35:55.683326 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:55.683304 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-xs86p_e4dced2d-1849-4c5f-9c39-d8d9052098aa/main/0.log" Jun 14 20:35:55.894411 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:55.894382 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp_a58010ea-c19c-486a-bc4e-29317e9c6082/storage-initializer/0.log" Jun 14 20:35:55.900746 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:55.900720 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-npzpp_a58010ea-c19c-486a-bc4e-29317e9c6082/main/0.log" Jun 14 20:35:56.223580 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:56.223551 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gfpsh_cd6641a0-0dd5-4ea6-9373-506221ea50f7/storage-initializer/0.log" Jun 14 20:35:56.229904 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:35:56.229881 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gfpsh_cd6641a0-0dd5-4ea6-9373-506221ea50f7/main/0.log" Jun 14 20:36:02.827605 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:02.827574 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fjz5r_1e0406b2-ebe5-4cb4-8b2a-2bd53a184704/global-pull-secret-syncer/0.log" Jun 14 20:36:02.928535 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:02.928504 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r8zm6_6790b23e-adb1-4356-ba9d-6ddb3b1208d2/konnectivity-agent/0.log" Jun 14 20:36:02.982442 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:02.982411 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-94.ec2.internal_0e303832cd2012a08bddfe235a4cca33/haproxy/0.log" Jun 14 20:36:06.542545 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:06.542513 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-w9xwq_1bda2db2-dba0-4dc3-bfb0-a569b758836a/sail-operator/0.log" Jun 14 20:36:07.780761 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:07.780728 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-thb48_a1e078ff-099e-4f44-aab9-85fc5fbe791e/manager/0.log" Jun 14 20:36:07.799975 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:07.799946 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vmdjx_045f8d23-7cbd-47a3-bafa-5b2ca0c79134/limitador/0.log" Jun 14 20:36:09.989116 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:09.989089 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sr988_cd428857-4908-4839-96be-03f0a42e4688/node-exporter/0.log" Jun 14 20:36:10.003390 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:10.003365 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sr988_cd428857-4908-4839-96be-03f0a42e4688/kube-rbac-proxy/0.log" Jun 14 20:36:10.022733 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:10.022705 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sr988_cd428857-4908-4839-96be-03f0a42e4688/init-textfile/0.log" Jun 14 20:36:10.215627 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:10.215539 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f82df6c-b7a1-4002-a7ec-baa41d37e9d5/prometheus/0.log" Jun 14 20:36:10.231454 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:10.231426 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f82df6c-b7a1-4002-a7ec-baa41d37e9d5/config-reloader/0.log" Jun 14 20:36:10.262845 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:10.262813 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f82df6c-b7a1-4002-a7ec-baa41d37e9d5/thanos-sidecar/0.log" Jun 14 20:36:10.284999 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:10.284973 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f82df6c-b7a1-4002-a7ec-baa41d37e9d5/kube-rbac-proxy-web/0.log" Jun 14 20:36:10.300346 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:10.300322 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f82df6c-b7a1-4002-a7ec-baa41d37e9d5/kube-rbac-proxy/0.log" Jun 14 20:36:10.318234 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:10.318211 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f82df6c-b7a1-4002-a7ec-baa41d37e9d5/kube-rbac-proxy-thanos/0.log" Jun 14 20:36:10.337774 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:10.337751 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f82df6c-b7a1-4002-a7ec-baa41d37e9d5/init-config-reloader/0.log" Jun 14 20:36:13.607361 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.607315 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th"] Jun 14 20:36:13.611090 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.611068 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.613510 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.613490 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbsqn\"/\"kube-root-ca.crt\"" Jun 14 20:36:13.614503 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.614481 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xbsqn\"/\"default-dockercfg-csxq2\"" Jun 14 20:36:13.614588 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.614501 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbsqn\"/\"openshift-service-ca.crt\"" Jun 14 20:36:13.620018 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.619994 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th"] Jun 14 20:36:13.763715 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.763682 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58m5p\" (UniqueName: \"kubernetes.io/projected/5e36035d-1e4b-406c-a514-c35365952e93-kube-api-access-58m5p\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.763905 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.763738 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-lib-modules\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.763905 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.763778 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-podres\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.763905 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.763852 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-sys\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.763905 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.763875 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-proc\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.864755 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.864666 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58m5p\" (UniqueName: \"kubernetes.io/projected/5e36035d-1e4b-406c-a514-c35365952e93-kube-api-access-58m5p\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.864755 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.864731 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-lib-modules\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.864755 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.864750 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-podres\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.865050 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.864784 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-sys\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.865050 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.864847 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-proc\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.865050 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.864919 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-sys\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.865050 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.864940 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-lib-modules\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.865050 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.864931 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-proc\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.865050 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.864945 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e36035d-1e4b-406c-a514-c35365952e93-podres\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.872147 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.872124 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58m5p\" (UniqueName: \"kubernetes.io/projected/5e36035d-1e4b-406c-a514-c35365952e93-kube-api-access-58m5p\") pod \"perf-node-gather-daemonset-f52th\" (UID: \"5e36035d-1e4b-406c-a514-c35365952e93\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:13.921875 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:13.921831 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:14.049641 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:14.049614 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th"] Jun 14 20:36:14.051862 ip-10-0-132-94 kubenswrapper[2549]: W0614 20:36:14.051830 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5e36035d_1e4b_406c_a514_c35365952e93.slice/crio-35e6213a8c0803ee4233fbebff69d32d0b9b6fb5b4acf007b95126e22bbdd8b2 WatchSource:0}: Error finding container 35e6213a8c0803ee4233fbebff69d32d0b9b6fb5b4acf007b95126e22bbdd8b2: Status 404 returned error can't find the container with id 35e6213a8c0803ee4233fbebff69d32d0b9b6fb5b4acf007b95126e22bbdd8b2 Jun 14 20:36:14.991631 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:14.991598 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" event={"ID":"5e36035d-1e4b-406c-a514-c35365952e93","Type":"ContainerStarted","Data":"df695e82f73af7a4e678f43cf32cac6ddccded37da00def1e2f47acfe8b16ec7"} Jun 14 20:36:14.992041 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:14.991653 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" event={"ID":"5e36035d-1e4b-406c-a514-c35365952e93","Type":"ContainerStarted","Data":"35e6213a8c0803ee4233fbebff69d32d0b9b6fb5b4acf007b95126e22bbdd8b2"} Jun 14 20:36:14.992041 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:14.991726 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:15.007635 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:15.007587 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" podStartSLOduration=2.007570607 podStartE2EDuration="2.007570607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:36:15.006467372 +0000 UTC m=+1083.790943978" watchObservedRunningTime="2026-06-14 20:36:15.007570607 +0000 UTC m=+1083.792047198" Jun 14 20:36:15.227117 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:15.227085 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whcdl_1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313/dns/0.log" Jun 14 20:36:15.242159 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:15.242092 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whcdl_1a4201c9-61d8-48a2-a7fb-9c1f7f8eb313/kube-rbac-proxy/0.log" Jun 14 20:36:15.296529 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:15.296502 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5jkg_25d26a18-3ece-43ad-9dcf-6d29b9ac79f6/dns-node-resolver/0.log" Jun 14 20:36:15.778934 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:15.778909 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-696b9bdf5b-rghsb_354fe887-8a7e-4769-89d4-45bbecde7427/registry/0.log" Jun 14 20:36:15.782235 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:15.782213 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-696b9bdf5b-rghsb_354fe887-8a7e-4769-89d4-45bbecde7427/registry/1.log" Jun 14 20:36:15.818809 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:15.818783 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-phwh7_5a3f0d10-e063-4d46-8b37-56b372453e3f/node-ca/0.log" Jun 14 20:36:16.751765 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:16.751734 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2sbn4_62efdb13-f37e-4852-b6de-b5febc3d3c52/discovery/0.log" Jun 14 20:36:16.785773 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:16.785745 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-gntvx_fcee1cdb-b049-499f-9b1d-9bf76eee3c2e/kube-auth-proxy/0.log" Jun 14 20:36:17.474586 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:17.474539 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lfmgm_798a36ad-73f8-4038-8fd7-88530c89f53a/serve-healthcheck-canary/0.log" Jun 14 20:36:17.976174 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:17.976147 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lx4ct_6ab64754-87a9-4388-b82d-3fd889ec732f/kube-rbac-proxy/0.log" Jun 14 20:36:17.990808 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:17.990779 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lx4ct_6ab64754-87a9-4388-b82d-3fd889ec732f/exporter/0.log" Jun 14 20:36:18.005836 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:18.005786 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lx4ct_6ab64754-87a9-4388-b82d-3fd889ec732f/extractor/0.log" Jun 14 20:36:20.261687 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:20.261655 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d5957fd7b-vcksc_b1e4a489-5ae5-46cb-bc41-3ee76ede8b5d/nginx/0.log" Jun 14 20:36:20.279960 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:20.279933 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6ztcm_dbddeb7e-0485-4851-9047-60b14d7b5463/manager/0.log" Jun 14 20:36:20.306688 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:20.306656 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-944np_a8f6442f-f86b-4202-b2fd-f95b9b3c19e1/manager/0.log" Jun 14 20:36:20.323936 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:20.323917 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-585bd99f8d-fff9s_51255783-640a-46dc-9c6c-b4ae236bee5f/maas-api/0.log" Jun 14 20:36:20.362920 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:20.362895 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hhlth_27c35a0f-31c9-491a-8720-9d76dd19e483/server/0.log" Jun 14 20:36:20.404145 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:20.404098 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-v8bwc_ad0cbc31-cc53-4054-8546-0866e4661129/manager/0.log" Jun 14 20:36:20.421839 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:20.421815 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cf7969f6-nt8ft_8809b44c-9fb1-40b9-b314-a5a0255c704c/manager/0.log" Jun 14 20:36:20.436526 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:20.436504 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cf7969f6-nt8ft_8809b44c-9fb1-40b9-b314-a5a0255c704c/copy-manifests/0.log" Jun 14 20:36:21.006585 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:21.006559 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-f52th" Jun 14 20:36:28.033449 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:28.033420 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2sbn4_62efdb13-f37e-4852-b6de-b5febc3d3c52/discovery/0.log" Jun 14 20:36:28.055951 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:28.055927 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-gntvx_fcee1cdb-b049-499f-9b1d-9bf76eee3c2e/kube-auth-proxy/0.log" Jun 14 20:36:28.884657 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:28.884619 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwq64_3316c4e5-2257-4221-af64-fbbf79dc69b2/kube-multus-additional-cni-plugins/0.log" Jun 14 20:36:28.911515 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:28.911486 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwq64_3316c4e5-2257-4221-af64-fbbf79dc69b2/egress-router-binary-copy/0.log" Jun 14 20:36:28.950710 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:28.950667 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwq64_3316c4e5-2257-4221-af64-fbbf79dc69b2/cni-plugins/0.log" Jun 14 20:36:28.985044 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:28.985014 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwq64_3316c4e5-2257-4221-af64-fbbf79dc69b2/bond-cni-plugin/0.log" Jun 14 20:36:29.000086 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:29.000063 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwq64_3316c4e5-2257-4221-af64-fbbf79dc69b2/routeoverride-cni/0.log" Jun 14 20:36:29.015308 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:29.015281 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwq64_3316c4e5-2257-4221-af64-fbbf79dc69b2/whereabouts-cni-bincopy/0.log" Jun 14 20:36:29.030657 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:29.030632 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwq64_3316c4e5-2257-4221-af64-fbbf79dc69b2/whereabouts-cni/0.log" Jun 14 20:36:29.136646 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:29.136570 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2sbn4_62efdb13-f37e-4852-b6de-b5febc3d3c52/discovery/0.log" Jun 14 20:36:29.159357 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:29.159333 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-gntvx_fcee1cdb-b049-499f-9b1d-9bf76eee3c2e/kube-auth-proxy/0.log" Jun 14 20:36:29.222706 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:29.222682 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qcwf4_aa01d48d-795e-410a-bf18-c059910f998f/kube-multus/0.log" Jun 14 20:36:29.283593 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:29.283570 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-khjh8_7c228186-a35c-4a42-8470-6eba1873b428/network-metrics-daemon/0.log" Jun 14 20:36:29.302554 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:29.302533 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-khjh8_7c228186-a35c-4a42-8470-6eba1873b428/kube-rbac-proxy/0.log" Jun 14 20:36:30.453192 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.453163 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-controller/0.log" Jun 14 20:36:30.467364 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.467340 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/1.log" Jun 14 20:36:30.467496 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.467399 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovn-acl-logging/0.log" Jun 14 20:36:30.483132 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.483113 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/kube-rbac-proxy-node/0.log" Jun 14 20:36:30.498974 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.498951 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/kube-rbac-proxy-ovn-metrics/0.log" Jun 14 20:36:30.511041 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.511021 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/northd/0.log" Jun 14 20:36:30.525407 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.525374 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/nbdb/0.log" Jun 14 20:36:30.539775 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.539755 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/sbdb/0.log" Jun 14 20:36:30.572812 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.572783 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwm4z_e825813b-b013-4787-bd50-3d0079d10a17/ovnkube-controller/0.log" Jun 14 20:36:30.872383 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.872311 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2sbn4_62efdb13-f37e-4852-b6de-b5febc3d3c52/discovery/0.log" Jun 14 20:36:30.897048 ip-10-0-132-94 kubenswrapper[2549]: I0614 20:36:30.897024 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-gntvx_fcee1cdb-b049-499f-9b1d-9bf76eee3c2e/kube-auth-proxy/0.log"