Jun 03 15:40:47.897219 ip-10-0-128-175 systemd[1]: Starting Kubernetes Kubelet... Jun 03 15:40:48.299441 ip-10-0-128-175 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:40:48.299441 ip-10-0-128-175 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 15:40:48.299441 ip-10-0-128-175 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:40:48.299441 ip-10-0-128-175 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 15:40:48.299441 ip-10-0-128-175 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:40:48.301217 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.301118 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 15:40:48.305982 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.305953 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:48.305982 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.305976 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:48.305982 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.305980 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:48.305982 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.305983 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:48.305982 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.305988 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:48.305982 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.305991 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:48.305982 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.305994 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.305997 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306000 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306003 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306005 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306008 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306011 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306013 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306016 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306019 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306021 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306024 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306026 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306029 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306035 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306038 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306040 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306043 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306045 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306048 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:48.306245 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306051 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306054 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306056 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306059 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306063 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306067 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306072 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306075 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306078 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306081 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306084 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306087 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306089 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306092 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306096 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306099 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306101 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306105 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306108 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:48.306731 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306110 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306113 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306116 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306119 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306122 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306125 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306128 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306130 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306133 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306135 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306137 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306140 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306143 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306145 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306148 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306150 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306153 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306156 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306159 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306162 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:48.307223 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306164 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306167 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306169 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306172 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306175 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306177 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306180 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306183 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306186 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306189 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306192 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306194 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306199 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306203 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306205 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306208 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306211 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306213 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306216 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306219 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:48.307705 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306222 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306677 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306684 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306687 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306690 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306694 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306696 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306699 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306702 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306704 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306707 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306710 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306713 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306716 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306718 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306721 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306723 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306726 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306728 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306732 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:48.308206 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306735 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306738 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306741 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306743 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306746 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306749 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306752 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306755 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306758 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306760 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306763 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306765 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306768 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306770 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306772 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306775 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306777 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306780 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306784 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:48.308729 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306788 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306793 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306796 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306800 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306802 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306805 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306807 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306810 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306812 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306815 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306817 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306820 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306823 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306826 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306829 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306831 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306834 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306837 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306839 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306842 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:48.309217 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306844 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306847 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306849 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306852 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306854 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306857 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306860 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306863 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306865 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306868 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306870 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306872 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306875 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306877 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306880 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306883 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306885 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306888 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306890 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306893 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:48.309702 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306895 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306898 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306900 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306903 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306905 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306908 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306911 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.306913 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308104 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308115 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308122 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308127 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308133 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308136 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308141 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308145 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308149 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308152 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308155 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308159 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308162 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308165 2566 flags.go:64] FLAG: --cgroup-root="" Jun 03 15:40:48.310199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308167 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308170 2566 flags.go:64] FLAG: --client-ca-file="" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308173 2566 flags.go:64] FLAG: --cloud-config="" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308177 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308180 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308184 2566 flags.go:64] FLAG: --cluster-domain="" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308187 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308190 2566 flags.go:64] FLAG: --config-dir="" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308193 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308196 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308200 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308203 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308207 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308210 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308214 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308217 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308219 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308223 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308226 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308230 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308234 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308237 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308239 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308243 2566 flags.go:64] FLAG: --enable-server="true" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308246 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 15:40:48.310733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308251 2566 flags.go:64] FLAG: --event-burst="100" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308255 2566 flags.go:64] FLAG: --event-qps="50" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308257 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308261 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308263 2566 flags.go:64] FLAG: --eviction-hard="" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308267 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308270 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308273 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308276 2566 flags.go:64] FLAG: --eviction-soft="" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308279 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308281 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308284 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308287 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308290 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308293 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308296 2566 flags.go:64] FLAG: --feature-gates="" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308300 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308303 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308306 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308309 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308312 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308316 2566 flags.go:64] FLAG: --help="false" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308319 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308322 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 15:40:48.311353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308325 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308328 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308331 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308335 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308338 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308341 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308344 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308347 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308351 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308354 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308357 2566 flags.go:64] FLAG: --kube-reserved="" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308359 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308362 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308365 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308368 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308371 2566 flags.go:64] FLAG: --lock-file="" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308374 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308377 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308380 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308386 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308389 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308392 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308395 2566 flags.go:64] FLAG: --logging-format="text" Jun 03 15:40:48.311939 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308398 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308401 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308404 2566 flags.go:64] FLAG: --manifest-url="" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308407 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308411 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308414 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308419 2566 flags.go:64] FLAG: --max-pods="110" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308422 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308425 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308428 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308431 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308434 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308437 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308440 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308448 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308451 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308454 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308458 2566 flags.go:64] FLAG: --pod-cidr="" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308461 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308468 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308471 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308475 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308478 2566 flags.go:64] FLAG: --port="10250" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308481 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 15:40:48.312495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308484 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ac7191d01a28fca2" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308487 2566 flags.go:64] FLAG: --qos-reserved="" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308490 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308493 2566 flags.go:64] FLAG: --register-node="true" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308496 2566 flags.go:64] FLAG: --register-schedulable="true" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308499 2566 flags.go:64] FLAG: --register-with-taints="" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308503 2566 flags.go:64] FLAG: --registry-burst="10" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308506 2566 flags.go:64] FLAG: --registry-qps="5" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308509 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308512 2566 flags.go:64] FLAG: --reserved-memory="" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308515 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308519 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308522 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308525 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308528 2566 flags.go:64] FLAG: --runonce="false" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308531 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308534 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308537 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308540 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308543 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308546 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308549 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308552 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308555 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308558 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308568 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 15:40:48.313079 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308573 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308576 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308579 2566 flags.go:64] FLAG: --system-cgroups="" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308582 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308588 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308591 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308593 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308598 2566 flags.go:64] FLAG: --tls-min-version="" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308600 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308604 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308606 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308609 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308612 2566 flags.go:64] FLAG: --v="2" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308617 2566 flags.go:64] FLAG: --version="false" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308621 2566 flags.go:64] FLAG: --vmodule="" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308625 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.308628 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308738 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308742 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308745 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308747 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308754 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308756 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:48.313719 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308759 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308761 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308764 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308767 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308770 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308772 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308775 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308778 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308781 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308784 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308787 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308790 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308793 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308795 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308798 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308800 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308803 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308805 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308808 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308811 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308813 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:48.314434 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308816 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308818 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308821 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308824 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308826 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308829 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308831 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308834 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308837 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308841 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308844 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308846 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308849 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308851 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308854 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308856 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308861 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308865 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308868 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:48.315363 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308872 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308875 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308878 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308881 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308884 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308886 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308889 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308892 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308894 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308897 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308899 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308901 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308904 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308906 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308909 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308912 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308914 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308917 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308919 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308922 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:48.316225 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308936 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308939 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308943 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308947 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308951 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308954 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308957 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308960 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308962 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308964 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308967 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308970 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308974 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308976 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308979 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308982 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308984 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308987 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308990 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:48.317115 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.308992 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.309002 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.316322 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.316346 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316444 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316454 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316460 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316465 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316470 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316474 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316479 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316483 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316488 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316492 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316497 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316501 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:48.317852 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316505 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316509 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316514 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316519 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316523 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316528 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316532 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316537 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316541 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316545 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316549 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316554 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316557 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316562 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316566 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316570 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316574 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316578 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316582 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316594 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:48.318334 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316599 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316604 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316608 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316613 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316617 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316621 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316625 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316629 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316633 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316638 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316643 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316647 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316652 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316656 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316660 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316664 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316668 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316672 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316677 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316682 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:48.318968 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316686 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316690 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316697 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316705 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316710 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316714 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316719 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316723 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316728 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316732 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316737 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316744 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316751 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316755 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316760 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316764 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316768 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316772 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316777 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:48.319882 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316781 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316786 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316790 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316794 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316798 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316803 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316807 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316812 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316816 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316820 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316825 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316830 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316834 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316838 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.316842 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:48.320640 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.316850 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317040 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317079 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317085 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317090 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317095 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317100 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317105 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317110 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317115 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317119 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317124 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317128 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317133 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317137 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317142 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317146 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317151 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317156 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:48.321177 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317160 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317165 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317170 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317176 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317181 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317186 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317190 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317193 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317198 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317202 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317206 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317210 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317214 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317219 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317224 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317230 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317236 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317241 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317246 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:48.321734 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317251 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317256 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317261 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317266 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317270 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317275 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317280 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317285 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317289 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317294 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317298 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317302 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317306 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317310 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317315 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317320 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317324 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317329 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317333 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317337 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:48.322275 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317341 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317346 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317350 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317354 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317358 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317362 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317366 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317371 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317375 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317380 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317384 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317388 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317393 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317397 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317402 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317406 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317411 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317415 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317420 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317426 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:48.322778 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317430 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317435 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317439 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317443 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317447 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317453 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317457 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317461 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:48.317465 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.317472 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.318221 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.321135 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.322127 2566 server.go:1019] "Starting client certificate rotation" Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.322229 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:40:48.323338 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.322270 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:40:48.343009 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.342973 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:40:48.344976 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.344948 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:40:48.361155 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.361126 2566 log.go:25] "Validated CRI v1 runtime API" Jun 03 15:40:48.366672 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.366648 2566 log.go:25] "Validated CRI v1 image API" Jun 03 15:40:48.368551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.368533 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 15:40:48.371996 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.371974 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:40:48.373332 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.373310 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 edb02561-476b-4076-9518-463c6eea1cef:/dev/nvme0n1p3 ff5257db-95ce-4b10-b457-68443a4a1bf3:/dev/nvme0n1p4] Jun 03 15:40:48.373385 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.373331 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 15:40:48.377822 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.377695 2566 manager.go:217] Machine: {Timestamp:2026-06-03 15:40:48.377166592 +0000 UTC m=+0.373465710 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104660 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2137dad0c66206f03ba1f8041d12d3 SystemUUID:ec2137da-d0c6-6206-f03b-a1f8041d12d3 BootID:9d98fd4f-7f8b-4cd6-bbdf-c4c72d47a075 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9f:bf:6d:55:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9f:bf:6d:55:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:d3:89:32:42:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 15:40:48.378394 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.378381 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 15:40:48.378503 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.378489 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 15:40:48.380188 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.380160 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 15:40:48.380341 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.380192 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-175.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 15:40:48.380386 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.380352 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 15:40:48.380386 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.380361 2566 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 15:40:48.380386 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.380369 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:40:48.381613 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.381598 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:40:48.382495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.382483 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:40:48.382636 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.382626 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 15:40:48.384877 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.384860 2566 kubelet.go:491] "Attempting to sync node with API server" Jun 03 15:40:48.384966 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.384886 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 15:40:48.384966 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.384900 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 15:40:48.384966 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.384911 2566 kubelet.go:397] "Adding apiserver pod source" Jun 03 15:40:48.384966 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.384920 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 15:40:48.386136 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.386119 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:40:48.386229 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.386148 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:40:48.389067 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.389047 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 15:40:48.391020 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.391006 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 15:40:48.392763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.392739 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9b7ss" Jun 03 15:40:48.394074 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394062 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 15:40:48.394130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394080 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 15:40:48.394130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394086 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 15:40:48.394130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394092 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 15:40:48.394130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394100 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 15:40:48.394130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394107 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 15:40:48.394130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394112 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 15:40:48.394130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394119 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 15:40:48.394130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394125 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 15:40:48.394130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394131 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 15:40:48.394360 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394139 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 15:40:48.394360 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.394148 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 15:40:48.395490 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.395474 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 15:40:48.395490 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.395485 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 15:40:48.397814 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.397791 2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-175.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 15:40:48.397915 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.397814 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 15:40:48.397915 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.397849 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 15:40:48.398751 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.398711 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 15:40:48.398798 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.398754 2566 server.go:1295] "Started kubelet" Jun 03 15:40:48.398860 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.398810 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 15:40:48.398966 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.398864 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 15:40:48.398966 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.398942 2566 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 15:40:48.399819 ip-10-0-128-175 systemd[1]: Started Kubernetes Kubelet. Jun 03 15:40:48.402858 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.402826 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 15:40:48.403601 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.403586 2566 server.go:317] "Adding debug handlers to kubelet server" Jun 03 15:40:48.404285 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.404266 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9b7ss" Jun 03 15:40:48.408448 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.408422 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 15:40:48.408546 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.408472 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 15:40:48.408895 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.408878 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 15:40:48.409097 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409077 2566 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 15:40:48.409097 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409095 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 15:40:48.409234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409220 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 15:40:48.409340 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409305 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 03 15:40:48.409340 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409341 2566 reconciler.go:26] "Reconciler: start to sync state" Jun 03 15:40:48.409574 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409557 2566 factory.go:55] Registering systemd factory Jun 03 15:40:48.409657 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409584 2566 factory.go:223] Registration of the systemd container factory successfully Jun 03 15:40:48.409777 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.409753 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:48.409871 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409817 2566 factory.go:153] Registering CRI-O factory Jun 03 15:40:48.409871 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409827 2566 factory.go:223] Registration of the crio container factory successfully Jun 03 15:40:48.409871 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409870 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 15:40:48.410063 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409886 2566 factory.go:103] Registering Raw factory Jun 03 15:40:48.410063 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.409900 2566 manager.go:1196] Started watching for new ooms in manager Jun 03 15:40:48.410324 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.410310 2566 manager.go:319] Starting recovery of all containers Jun 03 15:40:48.417191 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.417162 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:48.420585 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.420327 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-175.ec2.internal\" not found" node="ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.420585 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.420522 2566 manager.go:324] Recovery completed Jun 03 15:40:48.424984 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.424919 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:48.427298 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.427280 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:48.427384 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.427313 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:48.427384 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.427327 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:48.427876 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.427864 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 15:40:48.427911 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.427876 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 15:40:48.427911 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.427894 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:40:48.430398 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.430383 2566 policy_none.go:49] "None policy: Start" Jun 03 15:40:48.430457 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.430403 2566 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 15:40:48.430457 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.430414 2566 state_mem.go:35] "Initializing new in-memory state store" Jun 03 15:40:48.474569 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.474549 2566 manager.go:341] "Starting Device Plugin manager" Jun 03 15:40:48.475907 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.474606 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 15:40:48.475907 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.474618 2566 server.go:85] "Starting device plugin registration server" Jun 03 15:40:48.475907 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.474864 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 15:40:48.475907 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.474874 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 15:40:48.475907 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.474970 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 15:40:48.475907 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.475086 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 15:40:48.475907 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.475103 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 15:40:48.475907 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.475686 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 15:40:48.475907 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.475730 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:48.536617 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.536570 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 15:40:48.537962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.537947 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 15:40:48.538017 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.537967 2566 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 15:40:48.538017 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.537988 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 15:40:48.538017 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.537998 2566 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 15:40:48.538182 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.538046 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 15:40:48.540475 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.540456 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:48.575829 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.575782 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:48.576813 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.576797 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:48.576896 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.576828 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:48.576896 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.576843 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:48.576896 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.576868 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.586097 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.586077 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.586157 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.586104 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-175.ec2.internal\": node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:48.600817 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.600693 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:48.638592 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.638552 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal"] Jun 03 15:40:48.638724 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.638661 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:48.641045 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.641030 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:48.641129 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.641058 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:48.641129 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.641068 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:48.642242 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.642230 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:48.642391 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.642376 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.642433 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.642406 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:48.643031 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.643017 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:48.643111 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.643035 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:48.643111 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.643044 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:48.643111 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.643054 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:48.643111 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.643057 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:48.643111 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.643064 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:48.644133 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.644117 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.644213 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.644148 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:48.644795 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.644778 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:48.644883 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.644801 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:48.644883 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.644815 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:48.675114 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.675089 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-175.ec2.internal\" not found" node="ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.679503 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.679487 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-175.ec2.internal\" not found" node="ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.700995 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.700963 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:48.711513 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.711486 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8a79d70a1a05ed83b041f18293df5ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal\" (UID: \"a8a79d70a1a05ed83b041f18293df5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.711582 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.711522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8a79d70a1a05ed83b041f18293df5ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal\" (UID: \"a8a79d70a1a05ed83b041f18293df5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.711582 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.711545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/268f67120e3f2c1264b8612c9914095e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-175.ec2.internal\" (UID: \"268f67120e3f2c1264b8612c9914095e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.801321 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.801280 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:48.812685 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.812656 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8a79d70a1a05ed83b041f18293df5ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal\" (UID: \"a8a79d70a1a05ed83b041f18293df5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.812746 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.812679 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8a79d70a1a05ed83b041f18293df5ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal\" (UID: \"a8a79d70a1a05ed83b041f18293df5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.812746 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.812710 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/268f67120e3f2c1264b8612c9914095e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-175.ec2.internal\" (UID: \"268f67120e3f2c1264b8612c9914095e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.812746 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.812731 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8a79d70a1a05ed83b041f18293df5ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal\" (UID: \"a8a79d70a1a05ed83b041f18293df5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.812839 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.812739 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/268f67120e3f2c1264b8612c9914095e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-175.ec2.internal\" (UID: \"268f67120e3f2c1264b8612c9914095e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.812839 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.812787 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8a79d70a1a05ed83b041f18293df5ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal\" (UID: \"a8a79d70a1a05ed83b041f18293df5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.902195 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:48.902118 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:48.977636 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.977607 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" Jun 03 15:40:48.983183 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:48.983158 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal" Jun 03 15:40:49.002998 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:49.002960 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:49.103678 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:49.103621 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:49.204307 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:49.204237 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:49.211306 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.211280 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:49.304656 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:49.304620 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:49.322149 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.322117 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 15:40:49.322336 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.322317 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:40:49.322401 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.322325 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:40:49.322401 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.322325 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:40:49.405326 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:49.405294 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:49.407481 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.407455 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 15:35:48 +0000 UTC" deadline="2027-12-24 05:07:41.383515961 +0000 UTC" Jun 03 15:40:49.407553 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.407482 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13645h26m51.976037221s" Jun 03 15:40:49.408663 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.408644 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 15:40:49.418214 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.418183 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:40:49.442582 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.442546 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v5d85" Jun 03 15:40:49.448626 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.448603 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v5d85" Jun 03 15:40:49.506010 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:49.505914 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:49.561568 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:49.561531 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a79d70a1a05ed83b041f18293df5ea.slice/crio-3ff448d947eb66da571f75998a00b5062a39545e04775fd3ff93830b2f9bf719 WatchSource:0}: Error finding container 3ff448d947eb66da571f75998a00b5062a39545e04775fd3ff93830b2f9bf719: Status 404 returned error can't find the container with id 3ff448d947eb66da571f75998a00b5062a39545e04775fd3ff93830b2f9bf719 Jun 03 15:40:49.561786 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:49.561765 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268f67120e3f2c1264b8612c9914095e.slice/crio-2402cc34065de7d0c8b935eedde490c781d971cf41378c8e13c8c285abb41f4f WatchSource:0}: Error finding container 2402cc34065de7d0c8b935eedde490c781d971cf41378c8e13c8c285abb41f4f: Status 404 returned error can't find the container with id 2402cc34065de7d0c8b935eedde490c781d971cf41378c8e13c8c285abb41f4f Jun 03 15:40:49.566048 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.566029 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:40:49.606738 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:49.606689 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:49.707235 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:49.707187 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:49.807793 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:49.807695 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-175.ec2.internal\" not found" Jun 03 15:40:49.884559 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.884532 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:49.909097 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.909063 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" Jun 03 15:40:49.922018 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.921985 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:40:49.923104 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.923088 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal" Jun 03 15:40:49.930092 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:49.930072 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:40:50.385985 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.385952 2566 apiserver.go:52] "Watching apiserver" Jun 03 15:40:50.393150 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.393120 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 15:40:50.395726 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.395691 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-sz8cj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal","openshift-multus/multus-additional-cni-plugins-6dscr","openshift-multus/network-metrics-daemon-r8tzl","kube-system/konnectivity-agent-w8gqh","kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal","openshift-multus/multus-nv7mm","openshift-network-diagnostics/network-check-target-vdfz8","openshift-network-operator/iptables-alerter-rhqlv","openshift-ovn-kubernetes/ovnkube-node-2mdjq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs","openshift-cluster-node-tuning-operator/tuned-pfkkb","openshift-dns/node-resolver-wpptc"] Jun 03 15:40:50.400424 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.400380 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.403243 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.403117 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.404177 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.403992 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 15:40:50.404177 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.403993 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 15:40:50.404177 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.404073 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 15:40:50.404177 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.404123 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 15:40:50.404482 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.404258 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nrd7q\"" Jun 03 15:40:50.405487 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.405360 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mxb28\"" Jun 03 15:40:50.405487 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.405463 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:50.405640 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:50.405541 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:40:50.405952 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.405866 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 15:40:50.406273 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.406226 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 15:40:50.407566 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.407550 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:40:50.409954 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.409808 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.410046 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.410033 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 15:40:50.410464 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.410443 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 15:40:50.410547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.410506 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-64q26\"" Jun 03 15:40:50.412132 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.412104 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 15:40:50.412387 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.412352 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.412771 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.412513 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 15:40:50.412771 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.412588 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 15:40:50.412919 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.412832 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x7sgw\"" Jun 03 15:40:50.414690 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.414649 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:40:50.415104 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.415080 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g6gw5\"" Jun 03 15:40:50.415190 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.415094 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 15:40:50.415361 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.415343 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 15:40:50.415517 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.415503 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:50.415755 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:50.415720 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:40:50.415755 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.415753 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.418399 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.418351 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 15:40:50.418496 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.418414 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.418496 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.418428 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 15:40:50.418694 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.418675 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hdzfd\"" Jun 03 15:40:50.418955 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.418912 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 15:40:50.419191 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.419174 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 15:40:50.419272 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.419235 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 15:40:50.419321 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.419280 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 15:40:50.420811 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.420783 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.420908 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.420837 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 15:40:50.421073 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.420785 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 15:40:50.421502 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421482 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m6nxx\"" Jun 03 15:40:50.421587 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421487 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 15:40:50.421669 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421650 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-system-cni-dir\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.421725 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421681 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-system-cni-dir\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.421725 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421698 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99e17207-eb70-41e2-b081-32c67efb3585-cni-binary-copy\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.421725 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd3c1a3c-84a7-47ae-88b6-39e8fc262864-konnectivity-ca\") pod \"konnectivity-agent-w8gqh\" (UID: \"bd3c1a3c-84a7-47ae-88b6-39e8fc262864\") " pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:40:50.421945 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-run-k8s-cni-cncf-io\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.421945 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-var-lib-kubelet\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.421945 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-etc-kubernetes\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.421945 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2f6w\" (UniqueName: \"kubernetes.io/projected/99e17207-eb70-41e2-b081-32c67efb3585-kube-api-access-w2f6w\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.421945 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421880 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5842307-e08e-42fb-8caa-896c72c2085a-host\") pod \"node-ca-sz8cj\" (UID: \"e5842307-e08e-42fb-8caa-896c72c2085a\") " pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.421945 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:50.422234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.421947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-hostroot\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422013 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-run-multus-certs\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-cnibin\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.422234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422077 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.422234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6610f372-8966-4d48-a40a-4e0489632b7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.422234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5842307-e08e-42fb-8caa-896c72c2085a-serviceca\") pod \"node-ca-sz8cj\" (UID: \"e5842307-e08e-42fb-8caa-896c72c2085a\") " pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.422234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-os-release\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-multus-socket-dir-parent\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422200 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99e17207-eb70-41e2-b081-32c67efb3585-multus-daemon-config\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422275 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-cnibin\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-run-netns\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-var-lib-cni-bin\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422395 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-os-release\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6610f372-8966-4d48-a40a-4e0489632b7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwfn2\" (UniqueName: \"kubernetes.io/projected/6610f372-8966-4d48-a40a-4e0489632b7a-kube-api-access-fwfn2\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd3c1a3c-84a7-47ae-88b6-39e8fc262864-agent-certs\") pod \"konnectivity-agent-w8gqh\" (UID: \"bd3c1a3c-84a7-47ae-88b6-39e8fc262864\") " pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422487 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-multus-cni-dir\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-var-lib-cni-multus\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvm5x\" (UniqueName: \"kubernetes.io/projected/e5842307-e08e-42fb-8caa-896c72c2085a-kube-api-access-jvm5x\") pod \"node-ca-sz8cj\" (UID: \"e5842307-e08e-42fb-8caa-896c72c2085a\") " pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-multus-conf-dir\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.422611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6610f372-8966-4d48-a40a-4e0489632b7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.423330 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.422635 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qkbz\" (UniqueName: \"kubernetes.io/projected/ed7e5465-29a7-4ab3-b71f-305d11a1733e-kube-api-access-4qkbz\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:50.423330 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.423014 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:40:50.423554 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.423533 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7nfm7\"" Jun 03 15:40:50.423626 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.423575 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 15:40:50.423626 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.423543 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.425891 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.425869 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pzdzn\"" Jun 03 15:40:50.426009 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.425919 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 15:40:50.426644 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.426078 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 15:40:50.449491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.449454 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:35:49 +0000 UTC" deadline="2028-01-15 17:33:37.149300805 +0000 UTC" Jun 03 15:40:50.449633 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.449488 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14185h52m46.699816553s" Jun 03 15:40:50.510669 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.510641 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 15:40:50.523520 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-run-netns\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.523520 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-run\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.523760 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523585 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6caefd0-80ba-43d7-b47c-a7906247a283-tmp-dir\") pod \"node-resolver-wpptc\" (UID: \"f6caefd0-80ba-43d7-b47c-a7906247a283\") " pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.523760 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523617 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-hostroot\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.523760 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523650 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-run-multus-certs\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.523760 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523673 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-cnibin\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.523760 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-var-lib-openvswitch\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.523760 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523707 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-hostroot\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.523760 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523762 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-run-multus-certs\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523775 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-cnibin\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523806 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-os-release\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523835 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-multus-socket-dir-parent\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523853 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99e17207-eb70-41e2-b081-32c67efb3585-multus-daemon-config\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523875 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523900 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-kubernetes\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523941 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7291d0ca-8a1e-47e1-8edd-e958aa325c17-ovnkube-config\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523944 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-os-release\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7291d0ca-8a1e-47e1-8edd-e958aa325c17-env-overrides\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523942 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-multus-socket-dir-parent\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.523997 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-cnibin\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524029 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-cnibin\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:50.524031 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:50.524089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524063 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-run-netns\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:50.524123 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs podName:ed7e5465-29a7-4ab3-b71f-305d11a1733e nodeName:}" failed. No retries permitted until 2026-06-03 15:40:51.024083618 +0000 UTC m=+3.020382740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs") pod "network-metrics-daemon-r8tzl" (UID: "ed7e5465-29a7-4ab3-b71f-305d11a1733e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-run-netns\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524147 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-os-release\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524179 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwfn2\" (UniqueName: \"kubernetes.io/projected/6610f372-8966-4d48-a40a-4e0489632b7a-kube-api-access-fwfn2\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524207 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-os-release\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524213 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1288780e-f3e8-4850-ac96-1d68810dab73-iptables-alerter-script\") pod \"iptables-alerter-rhqlv\" (UID: \"1288780e-f3e8-4850-ac96-1d68810dab73\") " pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524240 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-lib-modules\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-tmp\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524298 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-var-lib-cni-multus\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524324 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-run-openvswitch\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-cni-netd\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524379 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-multus-conf-dir\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524398 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-var-lib-cni-multus\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524405 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6610f372-8966-4d48-a40a-4e0489632b7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-systemd\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.524753 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524444 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-multus-conf-dir\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524456 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-run-systemd\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524498 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-log-socket\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-run-ovn-kubernetes\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99e17207-eb70-41e2-b081-32c67efb3585-multus-daemon-config\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524550 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524602 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-system-cni-dir\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-sys\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-system-cni-dir\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524693 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524736 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99e17207-eb70-41e2-b081-32c67efb3585-cni-binary-copy\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524763 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-var-lib-kubelet\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524782 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpnh7\" (UniqueName: \"kubernetes.io/projected/fa944275-c441-46e1-8038-a315d719f46b-kube-api-access-bpnh7\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524856 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-var-lib-kubelet\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524888 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-etc-kubernetes\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524940 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524968 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-kubelet\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.525403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524970 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-etc-kubernetes\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524970 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-var-lib-kubelet\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.524993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-socket-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-sysconfig\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525177 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525209 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6610f372-8966-4d48-a40a-4e0489632b7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525239 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5842307-e08e-42fb-8caa-896c72c2085a-serviceca\") pod \"node-ca-sz8cj\" (UID: \"e5842307-e08e-42fb-8caa-896c72c2085a\") " pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5jq\" (UniqueName: \"kubernetes.io/projected/1288780e-f3e8-4850-ac96-1d68810dab73-kube-api-access-qm5jq\") pod \"iptables-alerter-rhqlv\" (UID: \"1288780e-f3e8-4850-ac96-1d68810dab73\") " pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-modprobe-d\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-sysctl-d\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525336 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-sysctl-conf\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525356 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6610f372-8966-4d48-a40a-4e0489632b7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525238 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99e17207-eb70-41e2-b081-32c67efb3585-cni-binary-copy\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525360 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7zm9\" (UniqueName: \"kubernetes.io/projected/f6caefd0-80ba-43d7-b47c-a7906247a283-kube-api-access-s7zm9\") pod \"node-resolver-wpptc\" (UID: \"f6caefd0-80ba-43d7-b47c-a7906247a283\") " pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525452 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6610f372-8966-4d48-a40a-4e0489632b7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-device-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.526041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525513 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-var-lib-cni-bin\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525550 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6610f372-8966-4d48-a40a-4e0489632b7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525579 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd3c1a3c-84a7-47ae-88b6-39e8fc262864-agent-certs\") pod \"konnectivity-agent-w8gqh\" (UID: \"bd3c1a3c-84a7-47ae-88b6-39e8fc262864\") " pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525607 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-var-lib-cni-bin\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525621 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6610f372-8966-4d48-a40a-4e0489632b7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1288780e-f3e8-4850-ac96-1d68810dab73-host-slash\") pod \"iptables-alerter-rhqlv\" (UID: \"1288780e-f3e8-4850-ac96-1d68810dab73\") " pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5842307-e08e-42fb-8caa-896c72c2085a-serviceca\") pod \"node-ca-sz8cj\" (UID: \"e5842307-e08e-42fb-8caa-896c72c2085a\") " pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-systemd-units\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525828 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-cni-bin\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7291d0ca-8a1e-47e1-8edd-e958aa325c17-ovn-node-metrics-cert\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525867 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-multus-cni-dir\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525884 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvm5x\" (UniqueName: \"kubernetes.io/projected/e5842307-e08e-42fb-8caa-896c72c2085a-kube-api-access-jvm5x\") pod \"node-ca-sz8cj\" (UID: \"e5842307-e08e-42fb-8caa-896c72c2085a\") " pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6caefd0-80ba-43d7-b47c-a7906247a283-hosts-file\") pod \"node-resolver-wpptc\" (UID: \"f6caefd0-80ba-43d7-b47c-a7906247a283\") " pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525942 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-etc-openvswitch\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-multus-cni-dir\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525966 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qkbz\" (UniqueName: \"kubernetes.io/projected/ed7e5465-29a7-4ab3-b71f-305d11a1733e-kube-api-access-4qkbz\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525969 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 15:40:50.526763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.525983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-run-ovn\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526002 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6610f372-8966-4d48-a40a-4e0489632b7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-node-log\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-registration-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526060 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-system-cni-dir\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-tuned\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87v7d\" (UniqueName: \"kubernetes.io/projected/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-kube-api-access-87v7d\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-sys-fs\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526143 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-system-cni-dir\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526151 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd3c1a3c-84a7-47ae-88b6-39e8fc262864-konnectivity-ca\") pod \"konnectivity-agent-w8gqh\" (UID: \"bd3c1a3c-84a7-47ae-88b6-39e8fc262864\") " pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-host\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526247 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-slash\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7291d0ca-8a1e-47e1-8edd-e958aa325c17-ovnkube-script-lib\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89ljv\" (UniqueName: \"kubernetes.io/projected/7291d0ca-8a1e-47e1-8edd-e958aa325c17-kube-api-access-89ljv\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526380 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-run-k8s-cni-cncf-io\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526407 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2f6w\" (UniqueName: \"kubernetes.io/projected/99e17207-eb70-41e2-b081-32c67efb3585-kube-api-access-w2f6w\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526432 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5842307-e08e-42fb-8caa-896c72c2085a-host\") pod \"node-ca-sz8cj\" (UID: \"e5842307-e08e-42fb-8caa-896c72c2085a\") " pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.527351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526460 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99e17207-eb70-41e2-b081-32c67efb3585-host-run-k8s-cni-cncf-io\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.527895 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5842307-e08e-42fb-8caa-896c72c2085a-host\") pod \"node-ca-sz8cj\" (UID: \"e5842307-e08e-42fb-8caa-896c72c2085a\") " pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.527895 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.526595 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd3c1a3c-84a7-47ae-88b6-39e8fc262864-konnectivity-ca\") pod \"konnectivity-agent-w8gqh\" (UID: \"bd3c1a3c-84a7-47ae-88b6-39e8fc262864\") " pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:40:50.529394 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.529374 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd3c1a3c-84a7-47ae-88b6-39e8fc262864-agent-certs\") pod \"konnectivity-agent-w8gqh\" (UID: \"bd3c1a3c-84a7-47ae-88b6-39e8fc262864\") " pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:40:50.542540 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.542482 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal" event={"ID":"268f67120e3f2c1264b8612c9914095e","Type":"ContainerStarted","Data":"2402cc34065de7d0c8b935eedde490c781d971cf41378c8e13c8c285abb41f4f"} Jun 03 15:40:50.543486 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.543457 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" event={"ID":"a8a79d70a1a05ed83b041f18293df5ea","Type":"ContainerStarted","Data":"3ff448d947eb66da571f75998a00b5062a39545e04775fd3ff93830b2f9bf719"} Jun 03 15:40:50.550157 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.550123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwfn2\" (UniqueName: \"kubernetes.io/projected/6610f372-8966-4d48-a40a-4e0489632b7a-kube-api-access-fwfn2\") pod \"multus-additional-cni-plugins-6dscr\" (UID: \"6610f372-8966-4d48-a40a-4e0489632b7a\") " pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.556306 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.556277 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qkbz\" (UniqueName: \"kubernetes.io/projected/ed7e5465-29a7-4ab3-b71f-305d11a1733e-kube-api-access-4qkbz\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:50.556450 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:50.556369 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:50.556450 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:50.556392 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:50.556450 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:50.556405 2566 projected.go:194] Error preparing data for projected volume kube-api-access-vc7dc for pod openshift-network-diagnostics/network-check-target-vdfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:50.556592 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:50.556474 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc podName:bb1b4768-cce2-4698-b2ac-9ecf05ebdd60 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:51.056455731 +0000 UTC m=+3.052754850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vc7dc" (UniqueName: "kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc") pod "network-check-target-vdfz8" (UID: "bb1b4768-cce2-4698-b2ac-9ecf05ebdd60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:50.557056 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.557035 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2f6w\" (UniqueName: \"kubernetes.io/projected/99e17207-eb70-41e2-b081-32c67efb3585-kube-api-access-w2f6w\") pod \"multus-nv7mm\" (UID: \"99e17207-eb70-41e2-b081-32c67efb3585\") " pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.557985 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.557906 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvm5x\" (UniqueName: \"kubernetes.io/projected/e5842307-e08e-42fb-8caa-896c72c2085a-kube-api-access-jvm5x\") pod \"node-ca-sz8cj\" (UID: \"e5842307-e08e-42fb-8caa-896c72c2085a\") " pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.627646 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627606 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5jq\" (UniqueName: \"kubernetes.io/projected/1288780e-f3e8-4850-ac96-1d68810dab73-kube-api-access-qm5jq\") pod \"iptables-alerter-rhqlv\" (UID: \"1288780e-f3e8-4850-ac96-1d68810dab73\") " pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.627646 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627645 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-modprobe-d\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.627877 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627662 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-sysctl-d\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.627877 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627782 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-sysctl-conf\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.627877 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627820 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zm9\" (UniqueName: \"kubernetes.io/projected/f6caefd0-80ba-43d7-b47c-a7906247a283-kube-api-access-s7zm9\") pod \"node-resolver-wpptc\" (UID: \"f6caefd0-80ba-43d7-b47c-a7906247a283\") " pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.627877 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627822 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-sysctl-d\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.627877 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627832 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-modprobe-d\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.627877 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627846 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-device-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627891 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-device-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627890 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1288780e-f3e8-4850-ac96-1d68810dab73-host-slash\") pod \"iptables-alerter-rhqlv\" (UID: \"1288780e-f3e8-4850-ac96-1d68810dab73\") " pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627923 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-systemd-units\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627939 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1288780e-f3e8-4850-ac96-1d68810dab73-host-slash\") pod \"iptables-alerter-rhqlv\" (UID: \"1288780e-f3e8-4850-ac96-1d68810dab73\") " pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.627981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-systemd-units\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628007 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-sysctl-conf\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628013 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-cni-bin\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628044 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-cni-bin\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628062 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7291d0ca-8a1e-47e1-8edd-e958aa325c17-ovn-node-metrics-cert\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628096 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6caefd0-80ba-43d7-b47c-a7906247a283-hosts-file\") pod \"node-resolver-wpptc\" (UID: \"f6caefd0-80ba-43d7-b47c-a7906247a283\") " pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628116 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-etc-openvswitch\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628138 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-run-ovn\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628160 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-node-log\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628202 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-registration-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628236 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-tuned\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-registration-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628244 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6caefd0-80ba-43d7-b47c-a7906247a283-hosts-file\") pod \"node-resolver-wpptc\" (UID: \"f6caefd0-80ba-43d7-b47c-a7906247a283\") " pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628206 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-node-log\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628263 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87v7d\" (UniqueName: \"kubernetes.io/projected/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-kube-api-access-87v7d\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-etc-openvswitch\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628329 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-run-ovn\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628355 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-sys-fs\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628379 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-host\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628401 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-slash\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628426 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7291d0ca-8a1e-47e1-8edd-e958aa325c17-ovnkube-script-lib\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628450 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89ljv\" (UniqueName: \"kubernetes.io/projected/7291d0ca-8a1e-47e1-8edd-e958aa325c17-kube-api-access-89ljv\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628475 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-run-netns\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628493 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-host\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628498 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-run\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-sys-fs\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.628800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628550 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6caefd0-80ba-43d7-b47c-a7906247a283-tmp-dir\") pod \"node-resolver-wpptc\" (UID: \"f6caefd0-80ba-43d7-b47c-a7906247a283\") " pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628533 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-run\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628585 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-var-lib-openvswitch\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628600 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-slash\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628626 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-var-lib-openvswitch\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628792 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-run-netns\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628823 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628864 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-kubernetes\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628890 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7291d0ca-8a1e-47e1-8edd-e958aa325c17-ovnkube-config\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628895 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6caefd0-80ba-43d7-b47c-a7906247a283-tmp-dir\") pod \"node-resolver-wpptc\" (UID: \"f6caefd0-80ba-43d7-b47c-a7906247a283\") " pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628914 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7291d0ca-8a1e-47e1-8edd-e958aa325c17-env-overrides\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628973 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-kubernetes\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.628982 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1288780e-f3e8-4850-ac96-1d68810dab73-iptables-alerter-script\") pod \"iptables-alerter-rhqlv\" (UID: \"1288780e-f3e8-4850-ac96-1d68810dab73\") " pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629029 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-lib-modules\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629057 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-tmp\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629085 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-run-openvswitch\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629111 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-cni-netd\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629143 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-systemd\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.629643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629168 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-run-systemd\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629195 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-log-socket\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629222 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-run-ovn-kubernetes\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629238 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7291d0ca-8a1e-47e1-8edd-e958aa325c17-ovnkube-script-lib\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629256 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629286 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-sys\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629313 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629342 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-var-lib-kubelet\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629367 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpnh7\" (UniqueName: \"kubernetes.io/projected/fa944275-c441-46e1-8038-a315d719f46b-kube-api-access-bpnh7\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629406 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-kubelet\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629412 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-lib-modules\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629415 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7291d0ca-8a1e-47e1-8edd-e958aa325c17-ovnkube-config\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629430 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-socket-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629459 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-sysconfig\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629483 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-run-systemd\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629498 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-systemd\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.630473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-cni-netd\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629546 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-sys\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-sysconfig\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-var-lib-kubelet\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629609 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-kubelet\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629699 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-socket-dir\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-run-openvswitch\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629781 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-host-run-ovn-kubernetes\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629969 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7291d0ca-8a1e-47e1-8edd-e958aa325c17-env-overrides\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.629981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa944275-c441-46e1-8038-a315d719f46b-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.630309 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7291d0ca-8a1e-47e1-8edd-e958aa325c17-log-socket\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.630383 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1288780e-f3e8-4850-ac96-1d68810dab73-iptables-alerter-script\") pod \"iptables-alerter-rhqlv\" (UID: \"1288780e-f3e8-4850-ac96-1d68810dab73\") " pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.631263 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.630651 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-etc-tuned\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.632212 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.632185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7291d0ca-8a1e-47e1-8edd-e958aa325c17-ovn-node-metrics-cert\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.633625 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.633600 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-tmp\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.651422 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.651340 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5jq\" (UniqueName: \"kubernetes.io/projected/1288780e-f3e8-4850-ac96-1d68810dab73-kube-api-access-qm5jq\") pod \"iptables-alerter-rhqlv\" (UID: \"1288780e-f3e8-4850-ac96-1d68810dab73\") " pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.651422 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.651341 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87v7d\" (UniqueName: \"kubernetes.io/projected/20d8d1c4-105b-4131-bf93-2e3ce6f33bc4-kube-api-access-87v7d\") pod \"tuned-pfkkb\" (UID: \"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.669721 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.669690 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89ljv\" (UniqueName: \"kubernetes.io/projected/7291d0ca-8a1e-47e1-8edd-e958aa325c17-kube-api-access-89ljv\") pod \"ovnkube-node-2mdjq\" (UID: \"7291d0ca-8a1e-47e1-8edd-e958aa325c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.669879 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.669698 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpnh7\" (UniqueName: \"kubernetes.io/projected/fa944275-c441-46e1-8038-a315d719f46b-kube-api-access-bpnh7\") pod \"aws-ebs-csi-driver-node-ktzcs\" (UID: \"fa944275-c441-46e1-8038-a315d719f46b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.671708 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.671680 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7zm9\" (UniqueName: \"kubernetes.io/projected/f6caefd0-80ba-43d7-b47c-a7906247a283-kube-api-access-s7zm9\") pod \"node-resolver-wpptc\" (UID: \"f6caefd0-80ba-43d7-b47c-a7906247a283\") " pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.715106 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.715070 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nv7mm" Jun 03 15:40:50.716183 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.715746 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:50.724029 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.724003 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6dscr" Jun 03 15:40:50.734815 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.734783 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:40:50.741443 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.741413 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sz8cj" Jun 03 15:40:50.751121 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.751083 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rhqlv" Jun 03 15:40:50.757955 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.757912 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:40:50.765864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.765834 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" Jun 03 15:40:50.771672 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.771648 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" Jun 03 15:40:50.778364 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.778336 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wpptc" Jun 03 15:40:50.844610 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:50.844585 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:51.032731 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.032650 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:51.032897 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:51.032770 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:51.032897 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:51.032825 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs podName:ed7e5465-29a7-4ab3-b71f-305d11a1733e nodeName:}" failed. No retries permitted until 2026-06-03 15:40:52.0328121 +0000 UTC m=+4.029111204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs") pod "network-metrics-daemon-r8tzl" (UID: "ed7e5465-29a7-4ab3-b71f-305d11a1733e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:51.133324 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.133285 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:51.133513 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:51.133437 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:51.133513 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:51.133457 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:51.133513 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:51.133467 2566 projected.go:194] Error preparing data for projected volume kube-api-access-vc7dc for pod openshift-network-diagnostics/network-check-target-vdfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:51.133669 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:51.133516 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc podName:bb1b4768-cce2-4698-b2ac-9ecf05ebdd60 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:52.133500463 +0000 UTC m=+4.129799569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc7dc" (UniqueName: "kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc") pod "network-check-target-vdfz8" (UID: "bb1b4768-cce2-4698-b2ac-9ecf05ebdd60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:51.285773 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:51.285736 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa944275_c441_46e1_8038_a315d719f46b.slice/crio-ff32ceb8aaee404319383c09b1d39282db9c2459267a1d8b41ce15e129573064 WatchSource:0}: Error finding container ff32ceb8aaee404319383c09b1d39282db9c2459267a1d8b41ce15e129573064: Status 404 returned error can't find the container with id ff32ceb8aaee404319383c09b1d39282db9c2459267a1d8b41ce15e129573064 Jun 03 15:40:51.288093 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:51.288064 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6caefd0_80ba_43d7_b47c_a7906247a283.slice/crio-93aad5d083c53fb1cc2542f18f375e208c8a08a5cc2820851bf0bd610b49b31f WatchSource:0}: Error finding container 93aad5d083c53fb1cc2542f18f375e208c8a08a5cc2820851bf0bd610b49b31f: Status 404 returned error can't find the container with id 93aad5d083c53fb1cc2542f18f375e208c8a08a5cc2820851bf0bd610b49b31f Jun 03 15:40:51.288704 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:51.288595 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5842307_e08e_42fb_8caa_896c72c2085a.slice/crio-8e672fac9454615103e49b160094885d6d7cd208282ede923e2df5910ee87b5f WatchSource:0}: Error finding container 8e672fac9454615103e49b160094885d6d7cd208282ede923e2df5910ee87b5f: Status 404 returned error can't find the container with id 8e672fac9454615103e49b160094885d6d7cd208282ede923e2df5910ee87b5f Jun 03 15:40:51.292633 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:51.292494 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6610f372_8966_4d48_a40a_4e0489632b7a.slice/crio-8846bd2fe69e395c9f89533c3f3ec97ce666b5ea7654156c1a883ef0944e0662 WatchSource:0}: Error finding container 8846bd2fe69e395c9f89533c3f3ec97ce666b5ea7654156c1a883ef0944e0662: Status 404 returned error can't find the container with id 8846bd2fe69e395c9f89533c3f3ec97ce666b5ea7654156c1a883ef0944e0662 Jun 03 15:40:51.293395 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:51.293370 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d8d1c4_105b_4131_bf93_2e3ce6f33bc4.slice/crio-a0ebc1ef5a82ca8d6e645c1a4f806d102340ffefe2313331ef4353d35385061b WatchSource:0}: Error finding container a0ebc1ef5a82ca8d6e645c1a4f806d102340ffefe2313331ef4353d35385061b: Status 404 returned error can't find the container with id a0ebc1ef5a82ca8d6e645c1a4f806d102340ffefe2313331ef4353d35385061b Jun 03 15:40:51.297789 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:51.297526 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1288780e_f3e8_4850_ac96_1d68810dab73.slice/crio-e182c9dd3fa47a9f5c95487c61d5a8a669843e19ea0c04884e809643d743b132 WatchSource:0}: Error finding container e182c9dd3fa47a9f5c95487c61d5a8a669843e19ea0c04884e809643d743b132: Status 404 returned error can't find the container with id e182c9dd3fa47a9f5c95487c61d5a8a669843e19ea0c04884e809643d743b132 Jun 03 15:40:51.298979 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:51.298946 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7291d0ca_8a1e_47e1_8edd_e958aa325c17.slice/crio-64c43476be10bf7b1b7ed6f447aeac06a3b345887ad7669232265e0e0a9fd2eb WatchSource:0}: Error finding container 64c43476be10bf7b1b7ed6f447aeac06a3b345887ad7669232265e0e0a9fd2eb: Status 404 returned error can't find the container with id 64c43476be10bf7b1b7ed6f447aeac06a3b345887ad7669232265e0e0a9fd2eb Jun 03 15:40:51.299969 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:40:51.299885 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3c1a3c_84a7_47ae_88b6_39e8fc262864.slice/crio-891c253d4ad4fb3e9fdddce138ca719356500c5235982a35f46556001f59727b WatchSource:0}: Error finding container 891c253d4ad4fb3e9fdddce138ca719356500c5235982a35f46556001f59727b: Status 404 returned error can't find the container with id 891c253d4ad4fb3e9fdddce138ca719356500c5235982a35f46556001f59727b Jun 03 15:40:51.450711 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.450523 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:35:49 +0000 UTC" deadline="2028-01-16 10:14:11.16912511 +0000 UTC" Jun 03 15:40:51.450711 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.450701 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14202h33m19.718426313s" Jun 03 15:40:51.538261 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.538156 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:51.538386 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:51.538263 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:40:51.547202 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.547162 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal" event={"ID":"268f67120e3f2c1264b8612c9914095e","Type":"ContainerStarted","Data":"4e64854b2d7e013ee41f2492d663f7018b067a34ae1113ec100a73d9046fa773"} Jun 03 15:40:51.549661 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.549628 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" event={"ID":"7291d0ca-8a1e-47e1-8edd-e958aa325c17","Type":"ContainerStarted","Data":"64c43476be10bf7b1b7ed6f447aeac06a3b345887ad7669232265e0e0a9fd2eb"} Jun 03 15:40:51.551078 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.551030 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8gqh" event={"ID":"bd3c1a3c-84a7-47ae-88b6-39e8fc262864","Type":"ContainerStarted","Data":"891c253d4ad4fb3e9fdddce138ca719356500c5235982a35f46556001f59727b"} Jun 03 15:40:51.552109 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.552084 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rhqlv" event={"ID":"1288780e-f3e8-4850-ac96-1d68810dab73","Type":"ContainerStarted","Data":"e182c9dd3fa47a9f5c95487c61d5a8a669843e19ea0c04884e809643d743b132"} Jun 03 15:40:51.553157 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.553134 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sz8cj" event={"ID":"e5842307-e08e-42fb-8caa-896c72c2085a","Type":"ContainerStarted","Data":"8e672fac9454615103e49b160094885d6d7cd208282ede923e2df5910ee87b5f"} Jun 03 15:40:51.554178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.554160 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wpptc" event={"ID":"f6caefd0-80ba-43d7-b47c-a7906247a283","Type":"ContainerStarted","Data":"93aad5d083c53fb1cc2542f18f375e208c8a08a5cc2820851bf0bd610b49b31f"} Jun 03 15:40:51.555298 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.555276 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" event={"ID":"fa944275-c441-46e1-8038-a315d719f46b","Type":"ContainerStarted","Data":"ff32ceb8aaee404319383c09b1d39282db9c2459267a1d8b41ce15e129573064"} Jun 03 15:40:51.557102 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.557010 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" event={"ID":"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4","Type":"ContainerStarted","Data":"a0ebc1ef5a82ca8d6e645c1a4f806d102340ffefe2313331ef4353d35385061b"} Jun 03 15:40:51.558047 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.558029 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nv7mm" event={"ID":"99e17207-eb70-41e2-b081-32c67efb3585","Type":"ContainerStarted","Data":"231a7e605551f620a05fea249aefa31231e216363a985b5c868914f13fea19b7"} Jun 03 15:40:51.559080 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.559057 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dscr" event={"ID":"6610f372-8966-4d48-a40a-4e0489632b7a","Type":"ContainerStarted","Data":"8846bd2fe69e395c9f89533c3f3ec97ce666b5ea7654156c1a883ef0944e0662"} Jun 03 15:40:51.560112 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.560066 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-175.ec2.internal" podStartSLOduration=2.560055253 podStartE2EDuration="2.560055253s" podCreationTimestamp="2026-06-03 15:40:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:40:51.55989783 +0000 UTC m=+3.556196957" watchObservedRunningTime="2026-06-03 15:40:51.560055253 +0000 UTC m=+3.556354380" Jun 03 15:40:51.729533 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:51.729232 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:52.039958 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:52.039908 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:52.040140 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:52.040072 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:52.040198 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:52.040144 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs podName:ed7e5465-29a7-4ab3-b71f-305d11a1733e nodeName:}" failed. No retries permitted until 2026-06-03 15:40:54.040122001 +0000 UTC m=+6.036421113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs") pod "network-metrics-daemon-r8tzl" (UID: "ed7e5465-29a7-4ab3-b71f-305d11a1733e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:52.141681 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:52.141042 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:52.141681 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:52.141236 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:52.141681 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:52.141256 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:52.141681 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:52.141270 2566 projected.go:194] Error preparing data for projected volume kube-api-access-vc7dc for pod openshift-network-diagnostics/network-check-target-vdfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:52.141681 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:52.141329 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc podName:bb1b4768-cce2-4698-b2ac-9ecf05ebdd60 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:54.141311603 +0000 UTC m=+6.137610713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc7dc" (UniqueName: "kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc") pod "network-check-target-vdfz8" (UID: "bb1b4768-cce2-4698-b2ac-9ecf05ebdd60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:52.540760 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:52.540163 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:52.540760 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:52.540363 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:40:52.575166 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:52.575128 2566 generic.go:358] "Generic (PLEG): container finished" podID="a8a79d70a1a05ed83b041f18293df5ea" containerID="a88f2b6f8f1e9494ecd3beb257686a696818e058257d6d23058c157b9e4d7f65" exitCode=0 Jun 03 15:40:52.576019 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:52.575991 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" event={"ID":"a8a79d70a1a05ed83b041f18293df5ea","Type":"ContainerDied","Data":"a88f2b6f8f1e9494ecd3beb257686a696818e058257d6d23058c157b9e4d7f65"} Jun 03 15:40:53.301317 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.301281 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4hqsw"] Jun 03 15:40:53.303883 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.303854 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.304070 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:53.304037 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:40:53.352525 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.352461 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d071120-940c-4ace-8749-8888b43406dc-kubelet-config\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.352525 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.352523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.352773 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.352584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d071120-940c-4ace-8749-8888b43406dc-dbus\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.453997 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.453186 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d071120-940c-4ace-8749-8888b43406dc-kubelet-config\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.453997 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.453240 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.453997 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.453296 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d071120-940c-4ace-8749-8888b43406dc-dbus\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.453997 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.453475 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d071120-940c-4ace-8749-8888b43406dc-kubelet-config\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.453997 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.453481 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d071120-940c-4ace-8749-8888b43406dc-dbus\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.453997 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:53.453574 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:53.453997 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:53.453647 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret podName:6d071120-940c-4ace-8749-8888b43406dc nodeName:}" failed. No retries permitted until 2026-06-03 15:40:53.953628096 +0000 UTC m=+5.949927204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret") pod "global-pull-secret-syncer-4hqsw" (UID: "6d071120-940c-4ace-8749-8888b43406dc") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:53.539572 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.539070 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:53.539572 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:53.539214 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:40:53.587163 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.587074 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" event={"ID":"a8a79d70a1a05ed83b041f18293df5ea","Type":"ContainerStarted","Data":"5e342055818efa759079da85e34a4742bb650d48f6da001cb3555d40fa0c7ab4"} Jun 03 15:40:53.602777 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.602724 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-175.ec2.internal" podStartSLOduration=4.6027047 podStartE2EDuration="4.6027047s" podCreationTimestamp="2026-06-03 15:40:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:40:53.601863908 +0000 UTC m=+5.598163041" watchObservedRunningTime="2026-06-03 15:40:53.6027047 +0000 UTC m=+5.599003830" Jun 03 15:40:53.958473 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:53.958438 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:53.958699 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:53.958615 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:53.958779 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:53.958743 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret podName:6d071120-940c-4ace-8749-8888b43406dc nodeName:}" failed. No retries permitted until 2026-06-03 15:40:54.958723543 +0000 UTC m=+6.955022669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret") pod "global-pull-secret-syncer-4hqsw" (UID: "6d071120-940c-4ace-8749-8888b43406dc") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:54.059587 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:54.059535 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:54.059768 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:54.059728 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:54.059831 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:54.059796 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs podName:ed7e5465-29a7-4ab3-b71f-305d11a1733e nodeName:}" failed. No retries permitted until 2026-06-03 15:40:58.059777304 +0000 UTC m=+10.056076416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs") pod "network-metrics-daemon-r8tzl" (UID: "ed7e5465-29a7-4ab3-b71f-305d11a1733e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:54.160794 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:54.160762 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:54.161066 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:54.161017 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:54.161066 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:54.161041 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:54.161066 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:54.161054 2566 projected.go:194] Error preparing data for projected volume kube-api-access-vc7dc for pod openshift-network-diagnostics/network-check-target-vdfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:54.161305 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:54.161126 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc podName:bb1b4768-cce2-4698-b2ac-9ecf05ebdd60 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:58.161107436 +0000 UTC m=+10.157406558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc7dc" (UniqueName: "kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc") pod "network-check-target-vdfz8" (UID: "bb1b4768-cce2-4698-b2ac-9ecf05ebdd60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:54.538971 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:54.538898 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:54.539204 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:54.539096 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:40:54.967951 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:54.967713 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:54.967951 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:54.967894 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:54.968473 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:54.967979 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret podName:6d071120-940c-4ace-8749-8888b43406dc nodeName:}" failed. No retries permitted until 2026-06-03 15:40:56.967961382 +0000 UTC m=+8.964260487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret") pod "global-pull-secret-syncer-4hqsw" (UID: "6d071120-940c-4ace-8749-8888b43406dc") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:55.539186 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:55.539105 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:55.539186 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:55.539139 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:55.539417 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:55.539251 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:40:55.539688 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:55.539640 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:40:56.538426 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:56.538377 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:56.538893 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:56.538514 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:40:56.986358 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:56.986265 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:56.986542 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:56.986385 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:56.986542 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:56.986497 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret podName:6d071120-940c-4ace-8749-8888b43406dc nodeName:}" failed. No retries permitted until 2026-06-03 15:41:00.986447504 +0000 UTC m=+12.982746619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret") pod "global-pull-secret-syncer-4hqsw" (UID: "6d071120-940c-4ace-8749-8888b43406dc") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:57.538515 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:57.538465 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:57.538515 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:57.538503 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:57.539138 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:57.538644 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:40:57.539138 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:57.538792 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:40:58.094720 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:58.094592 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:58.094964 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:58.094736 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:58.094964 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:58.094820 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs podName:ed7e5465-29a7-4ab3-b71f-305d11a1733e nodeName:}" failed. No retries permitted until 2026-06-03 15:41:06.094796251 +0000 UTC m=+18.091095359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs") pod "network-metrics-daemon-r8tzl" (UID: "ed7e5465-29a7-4ab3-b71f-305d11a1733e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:58.196481 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:58.195759 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:58.196481 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:58.196008 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:58.196481 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:58.196031 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:58.196481 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:58.196044 2566 projected.go:194] Error preparing data for projected volume kube-api-access-vc7dc for pod openshift-network-diagnostics/network-check-target-vdfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:58.196481 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:58.196118 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc podName:bb1b4768-cce2-4698-b2ac-9ecf05ebdd60 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:06.196098724 +0000 UTC m=+18.192397837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc7dc" (UniqueName: "kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc") pod "network-check-target-vdfz8" (UID: "bb1b4768-cce2-4698-b2ac-9ecf05ebdd60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:58.539655 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:58.539274 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:40:58.539655 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:58.539393 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:40:59.539419 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:59.539082 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:40:59.539419 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:59.539240 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:40:59.539676 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:40:59.539463 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:40:59.539676 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:40:59.539579 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:00.539399 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:00.539363 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:00.539580 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:00.539503 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:01.022197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:01.022106 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:01.022584 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:01.022285 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:41:01.022584 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:01.022363 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret podName:6d071120-940c-4ace-8749-8888b43406dc nodeName:}" failed. No retries permitted until 2026-06-03 15:41:09.022346426 +0000 UTC m=+21.018645541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret") pod "global-pull-secret-syncer-4hqsw" (UID: "6d071120-940c-4ace-8749-8888b43406dc") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:41:01.538867 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:01.538831 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:01.538867 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:01.538859 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:01.539079 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:01.538972 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:01.539119 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:01.539078 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:02.538874 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:02.538837 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:02.539444 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:02.538977 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:03.538558 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:03.538518 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:03.538759 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:03.538518 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:03.538759 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:03.538678 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:03.538857 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:03.538751 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:04.539197 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:04.539154 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:04.539659 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:04.539271 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:05.539214 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:05.539171 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:05.539747 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:05.539315 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:05.539747 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:05.539378 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:05.539747 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:05.539491 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:06.155851 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:06.155762 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:06.156023 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:06.155952 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:41:06.156101 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:06.156033 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs podName:ed7e5465-29a7-4ab3-b71f-305d11a1733e nodeName:}" failed. No retries permitted until 2026-06-03 15:41:22.156012118 +0000 UTC m=+34.152311223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs") pod "network-metrics-daemon-r8tzl" (UID: "ed7e5465-29a7-4ab3-b71f-305d11a1733e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:41:06.256882 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:06.256834 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:06.257066 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:06.257019 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:41:06.257066 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:06.257049 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:41:06.257066 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:06.257060 2566 projected.go:194] Error preparing data for projected volume kube-api-access-vc7dc for pod openshift-network-diagnostics/network-check-target-vdfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:41:06.257221 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:06.257117 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc podName:bb1b4768-cce2-4698-b2ac-9ecf05ebdd60 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:22.257101619 +0000 UTC m=+34.253400724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc7dc" (UniqueName: "kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc") pod "network-check-target-vdfz8" (UID: "bb1b4768-cce2-4698-b2ac-9ecf05ebdd60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:41:06.538786 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:06.538698 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:06.538958 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:06.538820 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:07.538772 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:07.538741 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:07.539355 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:07.538741 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:07.539355 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:07.538857 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:07.539355 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:07.538974 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:08.538899 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:08.538855 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:08.539379 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:08.538989 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:09.078114 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:09.078057 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:09.078286 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:09.078208 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:41:09.078286 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:09.078283 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret podName:6d071120-940c-4ace-8749-8888b43406dc nodeName:}" failed. No retries permitted until 2026-06-03 15:41:25.07826156 +0000 UTC m=+37.074560666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret") pod "global-pull-secret-syncer-4hqsw" (UID: "6d071120-940c-4ace-8749-8888b43406dc") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:41:09.539026 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:09.538943 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:09.539429 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:09.538943 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:09.539429 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:09.539091 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:09.539429 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:09.539154 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:10.539025 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.538680 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:10.539677 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:10.539126 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:10.618997 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.618885 2566 generic.go:358] "Generic (PLEG): container finished" podID="6610f372-8966-4d48-a40a-4e0489632b7a" containerID="6d3e2694baf9e5dea4bdf016a76836555e69d8c0f54e9665e4ee5f3b856f0ef9" exitCode=0 Jun 03 15:41:10.619150 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.619003 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dscr" event={"ID":"6610f372-8966-4d48-a40a-4e0489632b7a","Type":"ContainerDied","Data":"6d3e2694baf9e5dea4bdf016a76836555e69d8c0f54e9665e4ee5f3b856f0ef9"} Jun 03 15:41:10.622083 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.622052 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" event={"ID":"7291d0ca-8a1e-47e1-8edd-e958aa325c17","Type":"ContainerStarted","Data":"c64e0f8c282e3a5c16a79704c99bbe0683be2d8765d8378cab2a789fbd851412"} Jun 03 15:41:10.622176 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.622093 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" event={"ID":"7291d0ca-8a1e-47e1-8edd-e958aa325c17","Type":"ContainerStarted","Data":"d35865579d636853412d81692c9a74ca9671b8b30e8a75565b1db3cbbbc2ed8d"} Jun 03 15:41:10.622176 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.622108 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" event={"ID":"7291d0ca-8a1e-47e1-8edd-e958aa325c17","Type":"ContainerStarted","Data":"7bc08c036bd3bc54bd7e57c6c10f8205d58f126ae5db23049f39c192263577a8"} Jun 03 15:41:10.622176 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.622121 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" event={"ID":"7291d0ca-8a1e-47e1-8edd-e958aa325c17","Type":"ContainerStarted","Data":"8fea86bf1e15a6db781716f1919ea35c75f902204feabfa6bbebe9e290e18d91"} Jun 03 15:41:10.622176 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.622133 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" event={"ID":"7291d0ca-8a1e-47e1-8edd-e958aa325c17","Type":"ContainerStarted","Data":"90dc84643208e93252ffdaeeb977c62221a8b9222b6260adcec7ddede2aff758"} Jun 03 15:41:10.622176 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.622146 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" event={"ID":"7291d0ca-8a1e-47e1-8edd-e958aa325c17","Type":"ContainerStarted","Data":"d9d4778df47bdf5ac4c2785c2fd5997462b35aff998d80cbe8729be576e21aab"} Jun 03 15:41:10.623572 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.623550 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8gqh" event={"ID":"bd3c1a3c-84a7-47ae-88b6-39e8fc262864","Type":"ContainerStarted","Data":"7b9ac6ec2efdabe2631886000c18183350314d0c82df771bead3be481473e09e"} Jun 03 15:41:10.624923 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.624896 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sz8cj" event={"ID":"e5842307-e08e-42fb-8caa-896c72c2085a","Type":"ContainerStarted","Data":"9bb67376ba412785eb2952b799e8a24bc07c5453bd32fdeab604a6979e2366f9"} Jun 03 15:41:10.626407 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.626389 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wpptc" event={"ID":"f6caefd0-80ba-43d7-b47c-a7906247a283","Type":"ContainerStarted","Data":"b09595393b69728005fcf6a5e80bf99f3d9329b69789cbd9d10617686c2b92af"} Jun 03 15:41:10.627763 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.627741 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" event={"ID":"fa944275-c441-46e1-8038-a315d719f46b","Type":"ContainerStarted","Data":"4f729a7774325f019aa22bdfa658543f442261f144e8b1707535a5d0a455d1df"} Jun 03 15:41:10.629049 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.629005 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" event={"ID":"20d8d1c4-105b-4131-bf93-2e3ce6f33bc4","Type":"ContainerStarted","Data":"b5d2211e443b3166522c47b5cbb240688f1c9c29cda12b67d8a2d0459648af3f"} Jun 03 15:41:10.630427 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.630408 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nv7mm" event={"ID":"99e17207-eb70-41e2-b081-32c67efb3585","Type":"ContainerStarted","Data":"a06de6cb27886539c4f49f02faa6ca30b2f7fbaa44c095f5861c177206165b68"} Jun 03 15:41:10.658204 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.658150 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-wpptc" podStartSLOduration=4.272772481 podStartE2EDuration="22.658135897s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:40:51.291196803 +0000 UTC m=+3.287495911" lastFinishedPulling="2026-06-03 15:41:09.676560209 +0000 UTC m=+21.672859327" observedRunningTime="2026-06-03 15:41:10.65774914 +0000 UTC m=+22.654048268" watchObservedRunningTime="2026-06-03 15:41:10.658135897 +0000 UTC m=+22.654435024" Jun 03 15:41:10.676608 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.676551 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-nv7mm" podStartSLOduration=3.913118849 podStartE2EDuration="22.67653414s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:40:51.29877686 +0000 UTC m=+3.295075966" lastFinishedPulling="2026-06-03 15:41:10.062192138 +0000 UTC m=+22.058491257" observedRunningTime="2026-06-03 15:41:10.676326733 +0000 UTC m=+22.672625861" watchObservedRunningTime="2026-06-03 15:41:10.67653414 +0000 UTC m=+22.672833271" Jun 03 15:41:10.694677 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.694625 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pfkkb" podStartSLOduration=4.324500837 podStartE2EDuration="22.694605761s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:40:51.297106289 +0000 UTC m=+3.293405399" lastFinishedPulling="2026-06-03 15:41:09.667211201 +0000 UTC m=+21.663510323" observedRunningTime="2026-06-03 15:41:10.694288577 +0000 UTC m=+22.690587704" watchObservedRunningTime="2026-06-03 15:41:10.694605761 +0000 UTC m=+22.690904888" Jun 03 15:41:10.710617 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.710547 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w8gqh" podStartSLOduration=8.178545289 podStartE2EDuration="22.710525875s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:40:51.301906137 +0000 UTC m=+3.298205245" lastFinishedPulling="2026-06-03 15:41:05.833886717 +0000 UTC m=+17.830185831" observedRunningTime="2026-06-03 15:41:10.710089068 +0000 UTC m=+22.706388195" watchObservedRunningTime="2026-06-03 15:41:10.710525875 +0000 UTC m=+22.706825031" Jun 03 15:41:10.729038 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.728974 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sz8cj" podStartSLOduration=4.355207437 podStartE2EDuration="22.728955872s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:40:51.291252393 +0000 UTC m=+3.287551512" lastFinishedPulling="2026-06-03 15:41:09.665000832 +0000 UTC m=+21.661299947" observedRunningTime="2026-06-03 15:41:10.728110592 +0000 UTC m=+22.724409720" watchObservedRunningTime="2026-06-03 15:41:10.728955872 +0000 UTC m=+22.725255000" Jun 03 15:41:10.890411 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.890380 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 15:41:10.950919 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.950883 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:41:10.951525 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:10.951502 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:41:11.487220 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:11.487113 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:41:10.890400226Z","UUID":"fd596ba5-8c30-45d9-8347-e3cc650d19ee","Handler":null,"Name":"","Endpoint":""} Jun 03 15:41:11.489224 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:11.489167 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 15:41:11.489224 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:11.489201 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 15:41:11.539237 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:11.539202 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:11.539677 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:11.539202 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:11.539677 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:11.539339 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:11.539677 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:11.539421 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:11.634401 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:11.634362 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rhqlv" event={"ID":"1288780e-f3e8-4850-ac96-1d68810dab73","Type":"ContainerStarted","Data":"c597d7bf839dadbd916eff8b221f29956d2b20d7f6399215ac8b0f771e31e978"} Jun 03 15:41:11.636280 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:11.636242 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" event={"ID":"fa944275-c441-46e1-8038-a315d719f46b","Type":"ContainerStarted","Data":"9aebc903e52b3fdf60387d799db744222023f0ce23cab5a5de5075dc5809bc1f"} Jun 03 15:41:11.650539 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:11.650485 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rhqlv" podStartSLOduration=5.286163975 podStartE2EDuration="23.650469669s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:40:51.300725326 +0000 UTC m=+3.297024436" lastFinishedPulling="2026-06-03 15:41:09.665031013 +0000 UTC m=+21.661330130" observedRunningTime="2026-06-03 15:41:11.650108273 +0000 UTC m=+23.646407400" watchObservedRunningTime="2026-06-03 15:41:11.650469669 +0000 UTC m=+23.646768795" Jun 03 15:41:12.538405 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:12.538372 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:12.538573 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:12.538508 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:12.640784 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:12.640724 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" event={"ID":"fa944275-c441-46e1-8038-a315d719f46b","Type":"ContainerStarted","Data":"1f995ab51746525607e60e1b3ebc9d3fc5090c3d1c4aabcfda6c5e84b15cd9f7"} Jun 03 15:41:12.643964 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:12.643921 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" event={"ID":"7291d0ca-8a1e-47e1-8edd-e958aa325c17","Type":"ContainerStarted","Data":"2c9cb17c74f05689448889fafa764c5c4ddecd57ddd41a18e009152fe369def5"} Jun 03 15:41:12.644113 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:12.644004 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 15:41:12.663131 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:12.663064 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzcs" podStartSLOduration=4.264193261 podStartE2EDuration="24.66304569s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:40:51.287380006 +0000 UTC m=+3.283679123" lastFinishedPulling="2026-06-03 15:41:11.68623243 +0000 UTC m=+23.682531552" observedRunningTime="2026-06-03 15:41:12.662538297 +0000 UTC m=+24.658837426" watchObservedRunningTime="2026-06-03 15:41:12.66304569 +0000 UTC m=+24.659344821" Jun 03 15:41:13.280781 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:13.280743 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:41:13.281385 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:13.281359 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w8gqh" Jun 03 15:41:13.539252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:13.538955 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:13.539425 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:13.538955 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:13.539425 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:13.539322 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:13.539425 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:13.539399 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:14.538910 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:14.538873 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:14.539354 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:14.539039 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:15.538315 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:15.538146 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:15.538460 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:15.538160 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:15.538460 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:15.538412 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:15.538555 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:15.538483 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:15.651487 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:15.651451 2566 generic.go:358] "Generic (PLEG): container finished" podID="6610f372-8966-4d48-a40a-4e0489632b7a" containerID="d6b12111d76b19e664f2908c181a174ed3a2b38ae388100b8cd717a12979aab0" exitCode=0 Jun 03 15:41:15.652055 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:15.651533 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dscr" event={"ID":"6610f372-8966-4d48-a40a-4e0489632b7a","Type":"ContainerDied","Data":"d6b12111d76b19e664f2908c181a174ed3a2b38ae388100b8cd717a12979aab0"} Jun 03 15:41:15.654813 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:15.654702 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" event={"ID":"7291d0ca-8a1e-47e1-8edd-e958aa325c17","Type":"ContainerStarted","Data":"c45efa5e51b80b37854265a6e03039c7961f4a1f7f61af7ff17e74aea2899d92"} Jun 03 15:41:15.654978 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:15.654960 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:41:15.655038 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:15.655004 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:41:15.670168 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:15.670141 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:41:15.708199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:15.708064 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" podStartSLOduration=9.301607051 podStartE2EDuration="27.70804763s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:40:51.301092597 +0000 UTC m=+3.297391702" lastFinishedPulling="2026-06-03 15:41:09.707533171 +0000 UTC m=+21.703832281" observedRunningTime="2026-06-03 15:41:15.707303079 +0000 UTC m=+27.703602208" watchObservedRunningTime="2026-06-03 15:41:15.70804763 +0000 UTC m=+27.704346738" Jun 03 15:41:16.545006 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:16.544393 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:16.545006 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:16.544512 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:16.658733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:16.658702 2566 generic.go:358] "Generic (PLEG): container finished" podID="6610f372-8966-4d48-a40a-4e0489632b7a" containerID="c5ac50a5c44a02a6df0c89980019f77d3bf6af0f7ef12801245f39748d32af27" exitCode=0 Jun 03 15:41:16.659129 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:16.658746 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dscr" event={"ID":"6610f372-8966-4d48-a40a-4e0489632b7a","Type":"ContainerDied","Data":"c5ac50a5c44a02a6df0c89980019f77d3bf6af0f7ef12801245f39748d32af27"} Jun 03 15:41:16.659453 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:16.659355 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:41:16.674030 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:16.674003 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:41:17.197813 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:17.197773 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4hqsw"] Jun 03 15:41:17.198006 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:17.197945 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:17.198114 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:17.198067 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:17.201017 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:17.200955 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vdfz8"] Jun 03 15:41:17.201136 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:17.201057 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:17.201208 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:17.201147 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:17.201781 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:17.201754 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8tzl"] Jun 03 15:41:17.201890 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:17.201880 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:17.202023 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:17.202004 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:17.663089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:17.663005 2566 generic.go:358] "Generic (PLEG): container finished" podID="6610f372-8966-4d48-a40a-4e0489632b7a" containerID="852e7861c545a984c3a2db9dbe5a1f2f98cbd5290755d613ef61f87ae90a58fc" exitCode=0 Jun 03 15:41:17.663507 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:17.663083 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dscr" event={"ID":"6610f372-8966-4d48-a40a-4e0489632b7a","Type":"ContainerDied","Data":"852e7861c545a984c3a2db9dbe5a1f2f98cbd5290755d613ef61f87ae90a58fc"} Jun 03 15:41:18.539601 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:18.539563 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:18.539786 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:18.539686 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:19.538634 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:19.538540 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:19.539104 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:19.538545 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:19.539104 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:19.538679 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:19.539104 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:19.538734 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:20.539127 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:20.539090 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:20.539575 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:20.539260 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:21.538870 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:21.538831 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:21.539226 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:21.538834 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:21.539226 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:21.538993 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdfz8" podUID="bb1b4768-cce2-4698-b2ac-9ecf05ebdd60" Jun 03 15:41:21.539226 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:21.539037 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:41:22.179830 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.179788 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:22.180059 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:22.179969 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:41:22.180059 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:22.180050 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs podName:ed7e5465-29a7-4ab3-b71f-305d11a1733e nodeName:}" failed. No retries permitted until 2026-06-03 15:41:54.180029042 +0000 UTC m=+66.176328147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs") pod "network-metrics-daemon-r8tzl" (UID: "ed7e5465-29a7-4ab3-b71f-305d11a1733e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:41:22.280883 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.280841 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:22.281091 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:22.281011 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:41:22.281091 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:22.281031 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:41:22.281091 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:22.281043 2566 projected.go:194] Error preparing data for projected volume kube-api-access-vc7dc for pod openshift-network-diagnostics/network-check-target-vdfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:41:22.281249 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:22.281106 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc podName:bb1b4768-cce2-4698-b2ac-9ecf05ebdd60 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:54.281090469 +0000 UTC m=+66.277389573 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc7dc" (UniqueName: "kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc") pod "network-check-target-vdfz8" (UID: "bb1b4768-cce2-4698-b2ac-9ecf05ebdd60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:41:22.538800 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.538759 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:22.539016 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:22.538902 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hqsw" podUID="6d071120-940c-4ace-8749-8888b43406dc" Jun 03 15:41:22.824998 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.824902 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-175.ec2.internal" event="NodeReady" Jun 03 15:41:22.825539 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.825084 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 15:41:22.913587 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.913544 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lqvnf"] Jun 03 15:41:22.950821 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.950777 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hkb6b"] Jun 03 15:41:22.951007 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.950960 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:22.957909 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.957877 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 15:41:22.958089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.957913 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 15:41:22.958416 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.958369 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2z9xs\"" Jun 03 15:41:22.974681 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.974609 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lqvnf"] Jun 03 15:41:22.974681 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.974651 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkb6b"] Jun 03 15:41:22.974903 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.974775 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:22.978606 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.978551 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 15:41:22.979190 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.979167 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f2mct\"" Jun 03 15:41:22.983063 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.982812 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 15:41:22.983814 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:22.983792 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 15:41:23.087192 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.087102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf2ks\" (UniqueName: \"kubernetes.io/projected/b4d844ab-840b-4d1c-992a-0b6378488f99-kube-api-access-vf2ks\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.087192 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.087156 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4d844ab-840b-4d1c-992a-0b6378488f99-config-volume\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.087409 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.087211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:23.087409 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.087230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4d844ab-840b-4d1c-992a-0b6378488f99-tmp-dir\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.087409 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.087302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.087409 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.087349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcmzm\" (UniqueName: \"kubernetes.io/projected/615a5ed6-3481-43be-bf62-2821574f286b-kube-api-access-wcmzm\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:23.188313 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.188272 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2ks\" (UniqueName: \"kubernetes.io/projected/b4d844ab-840b-4d1c-992a-0b6378488f99-kube-api-access-vf2ks\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.188313 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.188322 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4d844ab-840b-4d1c-992a-0b6378488f99-config-volume\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.188546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.188354 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:23.188546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.188378 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4d844ab-840b-4d1c-992a-0b6378488f99-tmp-dir\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.188546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.188402 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.188546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.188450 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcmzm\" (UniqueName: \"kubernetes.io/projected/615a5ed6-3481-43be-bf62-2821574f286b-kube-api-access-wcmzm\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:23.188546 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:23.188523 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:23.188803 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:23.188587 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert podName:615a5ed6-3481-43be-bf62-2821574f286b nodeName:}" failed. No retries permitted until 2026-06-03 15:41:23.688566999 +0000 UTC m=+35.684866108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert") pod "ingress-canary-hkb6b" (UID: "615a5ed6-3481-43be-bf62-2821574f286b") : secret "canary-serving-cert" not found Jun 03 15:41:23.188803 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:23.188667 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:23.188803 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:23.188707 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls podName:b4d844ab-840b-4d1c-992a-0b6378488f99 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:23.688695074 +0000 UTC m=+35.684994180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls") pod "dns-default-lqvnf" (UID: "b4d844ab-840b-4d1c-992a-0b6378488f99") : secret "dns-default-metrics-tls" not found Jun 03 15:41:23.188964 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.188823 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4d844ab-840b-4d1c-992a-0b6378488f99-tmp-dir\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.189029 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.189005 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4d844ab-840b-4d1c-992a-0b6378488f99-config-volume\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.200774 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.200737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf2ks\" (UniqueName: \"kubernetes.io/projected/b4d844ab-840b-4d1c-992a-0b6378488f99-kube-api-access-vf2ks\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.200964 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.200863 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcmzm\" (UniqueName: \"kubernetes.io/projected/615a5ed6-3481-43be-bf62-2821574f286b-kube-api-access-wcmzm\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:23.538528 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.538488 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:23.538719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.538696 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:23.542190 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.542157 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:41:23.542345 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.542233 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7qpdh\"" Jun 03 15:41:23.542345 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.542234 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:41:23.542345 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.542321 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q8ntl\"" Jun 03 15:41:23.542474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.542441 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:41:23.693052 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.693015 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:23.693233 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:23.693078 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:23.693233 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:23.693172 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:23.693233 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:23.693194 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:23.693328 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:23.693242 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls podName:b4d844ab-840b-4d1c-992a-0b6378488f99 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:24.69322746 +0000 UTC m=+36.689526581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls") pod "dns-default-lqvnf" (UID: "b4d844ab-840b-4d1c-992a-0b6378488f99") : secret "dns-default-metrics-tls" not found Jun 03 15:41:23.693328 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:23.693256 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert podName:615a5ed6-3481-43be-bf62-2821574f286b nodeName:}" failed. No retries permitted until 2026-06-03 15:41:24.693251047 +0000 UTC m=+36.689550152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert") pod "ingress-canary-hkb6b" (UID: "615a5ed6-3481-43be-bf62-2821574f286b") : secret "canary-serving-cert" not found Jun 03 15:41:24.539128 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:24.539039 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:24.542181 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:24.542157 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:41:24.677944 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:24.677896 2566 generic.go:358] "Generic (PLEG): container finished" podID="6610f372-8966-4d48-a40a-4e0489632b7a" containerID="c7b935472636315727f28330feafa1adc434a952c81c9bc974dcb1e82ed91737" exitCode=0 Jun 03 15:41:24.678100 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:24.677971 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dscr" event={"ID":"6610f372-8966-4d48-a40a-4e0489632b7a","Type":"ContainerDied","Data":"c7b935472636315727f28330feafa1adc434a952c81c9bc974dcb1e82ed91737"} Jun 03 15:41:24.701691 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:24.701660 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:24.701757 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:24.701695 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:24.701807 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:24.701799 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:24.701852 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:24.701807 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:24.701888 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:24.701868 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls podName:b4d844ab-840b-4d1c-992a-0b6378488f99 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:26.701853958 +0000 UTC m=+38.698153063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls") pod "dns-default-lqvnf" (UID: "b4d844ab-840b-4d1c-992a-0b6378488f99") : secret "dns-default-metrics-tls" not found Jun 03 15:41:24.701888 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:24.701883 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert podName:615a5ed6-3481-43be-bf62-2821574f286b nodeName:}" failed. No retries permitted until 2026-06-03 15:41:26.701876515 +0000 UTC m=+38.698175620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert") pod "ingress-canary-hkb6b" (UID: "615a5ed6-3481-43be-bf62-2821574f286b") : secret "canary-serving-cert" not found Jun 03 15:41:25.104610 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:25.104511 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:25.106963 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:25.106910 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d071120-940c-4ace-8749-8888b43406dc-original-pull-secret\") pod \"global-pull-secret-syncer-4hqsw\" (UID: \"6d071120-940c-4ace-8749-8888b43406dc\") " pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:25.159080 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:25.159039 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hqsw" Jun 03 15:41:25.318567 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:25.318350 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4hqsw"] Jun 03 15:41:25.322676 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:41:25.322643 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d071120_940c_4ace_8749_8888b43406dc.slice/crio-992b5ebea431fd2469e35c1a073ae44986ff1347f74b45dc6f4ad95f0c155f03 WatchSource:0}: Error finding container 992b5ebea431fd2469e35c1a073ae44986ff1347f74b45dc6f4ad95f0c155f03: Status 404 returned error can't find the container with id 992b5ebea431fd2469e35c1a073ae44986ff1347f74b45dc6f4ad95f0c155f03 Jun 03 15:41:25.682627 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:25.682596 2566 generic.go:358] "Generic (PLEG): container finished" podID="6610f372-8966-4d48-a40a-4e0489632b7a" containerID="8d411a1a6b775c129c804dc759b870b364b040597478817bfcdb2bf0f32dcfd0" exitCode=0 Jun 03 15:41:25.683097 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:25.682667 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dscr" event={"ID":"6610f372-8966-4d48-a40a-4e0489632b7a","Type":"ContainerDied","Data":"8d411a1a6b775c129c804dc759b870b364b040597478817bfcdb2bf0f32dcfd0"} Jun 03 15:41:25.683728 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:25.683688 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4hqsw" event={"ID":"6d071120-940c-4ace-8749-8888b43406dc","Type":"ContainerStarted","Data":"992b5ebea431fd2469e35c1a073ae44986ff1347f74b45dc6f4ad95f0c155f03"} Jun 03 15:41:26.689117 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:26.689082 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dscr" event={"ID":"6610f372-8966-4d48-a40a-4e0489632b7a","Type":"ContainerStarted","Data":"73f3112267e1b85f2355e59dc568c0e50e1222ca174571a71bc1ee1e0ca8e2da"} Jun 03 15:41:26.718181 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:26.718141 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:26.718338 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:26.718205 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:26.718338 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:26.718293 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:26.718462 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:26.718355 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert podName:615a5ed6-3481-43be-bf62-2821574f286b nodeName:}" failed. No retries permitted until 2026-06-03 15:41:30.718337197 +0000 UTC m=+42.714636306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert") pod "ingress-canary-hkb6b" (UID: "615a5ed6-3481-43be-bf62-2821574f286b") : secret "canary-serving-cert" not found Jun 03 15:41:26.718462 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:26.718364 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:26.718462 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:26.718424 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls podName:b4d844ab-840b-4d1c-992a-0b6378488f99 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:30.718406279 +0000 UTC m=+42.714705383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls") pod "dns-default-lqvnf" (UID: "b4d844ab-840b-4d1c-992a-0b6378488f99") : secret "dns-default-metrics-tls" not found Jun 03 15:41:26.721266 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:26.721212 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6dscr" podStartSLOduration=6.059798487 podStartE2EDuration="38.721193719s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:40:51.295780358 +0000 UTC m=+3.292079467" lastFinishedPulling="2026-06-03 15:41:23.95717559 +0000 UTC m=+35.953474699" observedRunningTime="2026-06-03 15:41:26.720363637 +0000 UTC m=+38.716662766" watchObservedRunningTime="2026-06-03 15:41:26.721193719 +0000 UTC m=+38.717492847" Jun 03 15:41:30.750219 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:30.750164 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:30.750690 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:30.750281 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:30.750690 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:30.750326 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:30.750690 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:30.750381 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:30.750690 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:30.750420 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls podName:b4d844ab-840b-4d1c-992a-0b6378488f99 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:38.750401181 +0000 UTC m=+50.746700287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls") pod "dns-default-lqvnf" (UID: "b4d844ab-840b-4d1c-992a-0b6378488f99") : secret "dns-default-metrics-tls" not found Jun 03 15:41:30.750690 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:30.750451 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert podName:615a5ed6-3481-43be-bf62-2821574f286b nodeName:}" failed. No retries permitted until 2026-06-03 15:41:38.750430452 +0000 UTC m=+50.746729557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert") pod "ingress-canary-hkb6b" (UID: "615a5ed6-3481-43be-bf62-2821574f286b") : secret "canary-serving-cert" not found Jun 03 15:41:31.699981 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:31.699938 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4hqsw" event={"ID":"6d071120-940c-4ace-8749-8888b43406dc","Type":"ContainerStarted","Data":"39a18ca0b04d40fb8a5c01dfc7c087f80cad652afe3ba17bcab0121514507df7"} Jun 03 15:41:31.717788 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:31.717735 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4hqsw" podStartSLOduration=33.36959303 podStartE2EDuration="38.717718176s" podCreationTimestamp="2026-06-03 15:40:53 +0000 UTC" firstStartedPulling="2026-06-03 15:41:25.324392746 +0000 UTC m=+37.320691854" lastFinishedPulling="2026-06-03 15:41:30.672517892 +0000 UTC m=+42.668817000" observedRunningTime="2026-06-03 15:41:31.717249903 +0000 UTC m=+43.713549029" watchObservedRunningTime="2026-06-03 15:41:31.717718176 +0000 UTC m=+43.714017299" Jun 03 15:41:32.650792 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.650757 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4"] Jun 03 15:41:32.670798 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.670763 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4"] Jun 03 15:41:32.671030 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.670874 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" Jun 03 15:41:32.674479 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.674450 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 15:41:32.674622 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.674449 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 15:41:32.674622 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.674538 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 15:41:32.674622 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.674538 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-zjwd4\"" Jun 03 15:41:32.674789 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.674626 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 15:41:32.863606 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.863562 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85ft7\" (UniqueName: \"kubernetes.io/projected/bca6318c-5a99-4d15-9818-18a2845930fc-kube-api-access-85ft7\") pod \"managed-serviceaccount-addon-agent-556dd44754-f48c4\" (UID: \"bca6318c-5a99-4d15-9818-18a2845930fc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" Jun 03 15:41:32.863787 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.863623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bca6318c-5a99-4d15-9818-18a2845930fc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-556dd44754-f48c4\" (UID: \"bca6318c-5a99-4d15-9818-18a2845930fc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" Jun 03 15:41:32.964199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.964169 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85ft7\" (UniqueName: \"kubernetes.io/projected/bca6318c-5a99-4d15-9818-18a2845930fc-kube-api-access-85ft7\") pod \"managed-serviceaccount-addon-agent-556dd44754-f48c4\" (UID: \"bca6318c-5a99-4d15-9818-18a2845930fc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" Jun 03 15:41:32.964336 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.964222 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bca6318c-5a99-4d15-9818-18a2845930fc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-556dd44754-f48c4\" (UID: \"bca6318c-5a99-4d15-9818-18a2845930fc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" Jun 03 15:41:32.968201 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.968173 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bca6318c-5a99-4d15-9818-18a2845930fc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-556dd44754-f48c4\" (UID: \"bca6318c-5a99-4d15-9818-18a2845930fc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" Jun 03 15:41:32.974214 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.974183 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85ft7\" (UniqueName: \"kubernetes.io/projected/bca6318c-5a99-4d15-9818-18a2845930fc-kube-api-access-85ft7\") pod \"managed-serviceaccount-addon-agent-556dd44754-f48c4\" (UID: \"bca6318c-5a99-4d15-9818-18a2845930fc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" Jun 03 15:41:32.996041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:32.996004 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" Jun 03 15:41:33.127370 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:33.127330 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4"] Jun 03 15:41:33.130973 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:41:33.130943 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbca6318c_5a99_4d15_9818_18a2845930fc.slice/crio-843bb7ae5d11418aa2c9e2a7a2a51896f0b2967e418c427c6f7f5669ac77ea59 WatchSource:0}: Error finding container 843bb7ae5d11418aa2c9e2a7a2a51896f0b2967e418c427c6f7f5669ac77ea59: Status 404 returned error can't find the container with id 843bb7ae5d11418aa2c9e2a7a2a51896f0b2967e418c427c6f7f5669ac77ea59 Jun 03 15:41:33.705403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:33.705367 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" event={"ID":"bca6318c-5a99-4d15-9818-18a2845930fc","Type":"ContainerStarted","Data":"843bb7ae5d11418aa2c9e2a7a2a51896f0b2967e418c427c6f7f5669ac77ea59"} Jun 03 15:41:36.711803 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:36.711765 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" event={"ID":"bca6318c-5a99-4d15-9818-18a2845930fc","Type":"ContainerStarted","Data":"d04d68852faf3213d26fdfb08d72e9156774e05eddcacb712e8e1c6186437a5c"} Jun 03 15:41:36.731179 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:36.731129 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" podStartSLOduration=1.884505638 podStartE2EDuration="4.731112625s" podCreationTimestamp="2026-06-03 15:41:32 +0000 UTC" firstStartedPulling="2026-06-03 15:41:33.135650563 +0000 UTC m=+45.131949679" lastFinishedPulling="2026-06-03 15:41:35.982257558 +0000 UTC m=+47.978556666" observedRunningTime="2026-06-03 15:41:36.730564827 +0000 UTC m=+48.726863954" watchObservedRunningTime="2026-06-03 15:41:36.731112625 +0000 UTC m=+48.727411749" Jun 03 15:41:38.806431 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:38.806378 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:38.806431 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:38.806432 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:38.807051 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:38.806519 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:38.807051 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:38.806524 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:38.807051 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:38.806574 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls podName:b4d844ab-840b-4d1c-992a-0b6378488f99 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:54.806559868 +0000 UTC m=+66.802858973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls") pod "dns-default-lqvnf" (UID: "b4d844ab-840b-4d1c-992a-0b6378488f99") : secret "dns-default-metrics-tls" not found Jun 03 15:41:38.807051 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:38.806597 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert podName:615a5ed6-3481-43be-bf62-2821574f286b nodeName:}" failed. No retries permitted until 2026-06-03 15:41:54.806580793 +0000 UTC m=+66.802879897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert") pod "ingress-canary-hkb6b" (UID: "615a5ed6-3481-43be-bf62-2821574f286b") : secret "canary-serving-cert" not found Jun 03 15:41:48.676625 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:48.676594 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mdjq" Jun 03 15:41:54.209923 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.209877 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:41:54.213205 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.213187 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:41:54.220259 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:54.220239 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 15:41:54.220323 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:54.220316 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs podName:ed7e5465-29a7-4ab3-b71f-305d11a1733e nodeName:}" failed. No retries permitted until 2026-06-03 15:42:58.220298508 +0000 UTC m=+130.216597613 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs") pod "network-metrics-daemon-r8tzl" (UID: "ed7e5465-29a7-4ab3-b71f-305d11a1733e") : secret "metrics-daemon-secret" not found Jun 03 15:41:54.310776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.310730 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:54.314194 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.314175 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:41:54.324203 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.324175 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:41:54.335141 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.335109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc7dc\" (UniqueName: \"kubernetes.io/projected/bb1b4768-cce2-4698-b2ac-9ecf05ebdd60-kube-api-access-vc7dc\") pod \"network-check-target-vdfz8\" (UID: \"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60\") " pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:54.455300 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.455265 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7qpdh\"" Jun 03 15:41:54.461697 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.461642 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:54.585881 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.585847 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vdfz8"] Jun 03 15:41:54.589473 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:41:54.589443 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1b4768_cce2_4698_b2ac_9ecf05ebdd60.slice/crio-80a60a5c4869931e6e65bb21c61492efbbbdb810d8fc876235062437007c8cbf WatchSource:0}: Error finding container 80a60a5c4869931e6e65bb21c61492efbbbdb810d8fc876235062437007c8cbf: Status 404 returned error can't find the container with id 80a60a5c4869931e6e65bb21c61492efbbbdb810d8fc876235062437007c8cbf Jun 03 15:41:54.747512 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.747415 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vdfz8" event={"ID":"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60","Type":"ContainerStarted","Data":"80a60a5c4869931e6e65bb21c61492efbbbdb810d8fc876235062437007c8cbf"} Jun 03 15:41:54.814714 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.814679 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:41:54.814958 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:54.814751 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:41:54.814958 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:54.814851 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:54.814958 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:54.814855 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:54.814958 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:54.814921 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert podName:615a5ed6-3481-43be-bf62-2821574f286b nodeName:}" failed. No retries permitted until 2026-06-03 15:42:26.814903675 +0000 UTC m=+98.811202783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert") pod "ingress-canary-hkb6b" (UID: "615a5ed6-3481-43be-bf62-2821574f286b") : secret "canary-serving-cert" not found Jun 03 15:41:54.814958 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:41:54.814956 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls podName:b4d844ab-840b-4d1c-992a-0b6378488f99 nodeName:}" failed. No retries permitted until 2026-06-03 15:42:26.814949375 +0000 UTC m=+98.811248479 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls") pod "dns-default-lqvnf" (UID: "b4d844ab-840b-4d1c-992a-0b6378488f99") : secret "dns-default-metrics-tls" not found Jun 03 15:41:58.757552 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:58.757515 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vdfz8" event={"ID":"bb1b4768-cce2-4698-b2ac-9ecf05ebdd60","Type":"ContainerStarted","Data":"c26afe1b599ef53d7d82deab34e2252a2f75e9e335ac533385544e388a6ac32e"} Jun 03 15:41:58.757959 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:58.757672 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:41:58.776356 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:41:58.776303 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vdfz8" podStartSLOduration=67.579168289 podStartE2EDuration="1m10.776286799s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:41:54.591373039 +0000 UTC m=+66.587672148" lastFinishedPulling="2026-06-03 15:41:57.788491539 +0000 UTC m=+69.784790658" observedRunningTime="2026-06-03 15:41:58.775911335 +0000 UTC m=+70.772210465" watchObservedRunningTime="2026-06-03 15:41:58.776286799 +0000 UTC m=+70.772585926" Jun 03 15:42:26.841583 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:42:26.841536 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:42:26.842124 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:42:26.841622 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:42:26.842124 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:42:26.841681 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:42:26.842124 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:42:26.841699 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:42:26.842124 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:42:26.841759 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls podName:b4d844ab-840b-4d1c-992a-0b6378488f99 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:30.841742581 +0000 UTC m=+162.838041687 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls") pod "dns-default-lqvnf" (UID: "b4d844ab-840b-4d1c-992a-0b6378488f99") : secret "dns-default-metrics-tls" not found Jun 03 15:42:26.842124 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:42:26.841775 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert podName:615a5ed6-3481-43be-bf62-2821574f286b nodeName:}" failed. No retries permitted until 2026-06-03 15:43:30.841768335 +0000 UTC m=+162.838067440 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert") pod "ingress-canary-hkb6b" (UID: "615a5ed6-3481-43be-bf62-2821574f286b") : secret "canary-serving-cert" not found Jun 03 15:42:29.762722 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:42:29.762694 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vdfz8" Jun 03 15:42:58.251571 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:42:58.251524 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:42:58.252113 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:42:58.251650 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 15:42:58.252113 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:42:58.251715 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs podName:ed7e5465-29a7-4ab3-b71f-305d11a1733e nodeName:}" failed. No retries permitted until 2026-06-03 15:45:00.251700052 +0000 UTC m=+252.247999171 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs") pod "network-metrics-daemon-r8tzl" (UID: "ed7e5465-29a7-4ab3-b71f-305d11a1733e") : secret "metrics-daemon-secret" not found Jun 03 15:43:00.177204 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.177162 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-nhfqn"] Jun 03 15:43:00.180100 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.180078 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-54mdl"] Jun 03 15:43:00.180237 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.180223 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.182728 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.182708 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-559f5d94b9-tjsdn"] Jun 03 15:43:00.182860 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.182824 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.183494 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.183471 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:43:00.183576 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.183476 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 15:43:00.184943 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.184913 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 15:43:00.185358 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.185340 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.185853 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.185828 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6q99j\"" Jun 03 15:43:00.191764 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.191746 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 15:43:00.192082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.191997 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 15:43:00.192082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.192027 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 15:43:00.192082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.192004 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 15:43:00.192420 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.192404 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 15:43:00.192506 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.192426 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 15:43:00.192506 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.192449 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xs7n5\"" Jun 03 15:43:00.192506 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.192499 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 15:43:00.192879 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.192832 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 15:43:00.193121 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.193104 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4ph84\"" Jun 03 15:43:00.204628 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.204596 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 15:43:00.206056 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.206030 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 15:43:00.206202 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.206138 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 15:43:00.208953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.208907 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-nhfqn"] Jun 03 15:43:00.209661 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.209635 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-559f5d94b9-tjsdn"] Jun 03 15:43:00.210393 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.210365 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-54mdl"] Jun 03 15:43:00.257097 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.257062 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv"] Jun 03 15:43:00.259979 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.259964 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.265068 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.265036 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:43:00.265235 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.265101 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 15:43:00.265235 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.265107 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5vz76\"" Jun 03 15:43:00.265235 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.265208 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 15:43:00.265393 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.265250 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:43:00.266364 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266345 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605527c8-eded-4627-9588-a523bbac42dd-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.266445 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266374 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7292a296-6dcd-4b8d-873c-ce85ce1c570d-serving-cert\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.266445 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/605527c8-eded-4627-9588-a523bbac42dd-tmp\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.266509 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266470 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b52ms\" (UniqueName: \"kubernetes.io/projected/7292a296-6dcd-4b8d-873c-ce85ce1c570d-kube-api-access-b52ms\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.266509 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266488 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-certificates\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.266509 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/605527c8-eded-4627-9588-a523bbac42dd-serving-cert\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.266606 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7292a296-6dcd-4b8d-873c-ce85ce1c570d-trusted-ca\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.266606 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-image-registry-private-configuration\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.266606 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266566 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-installation-pull-secrets\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.266706 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-bound-sa-token\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.266706 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwgvf\" (UniqueName: \"kubernetes.io/projected/605527c8-eded-4627-9588-a523bbac42dd-kube-api-access-gwgvf\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.266706 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7292a296-6dcd-4b8d-873c-ce85ce1c570d-config\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.266795 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/659b5abc-2d68-4624-bcef-ddf3411e0512-ca-trust-extracted\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.266795 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/605527c8-eded-4627-9588-a523bbac42dd-snapshots\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.266795 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-trusted-ca\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.266890 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88jm\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-kube-api-access-j88jm\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.266890 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605527c8-eded-4627-9588-a523bbac42dd-service-ca-bundle\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.266890 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.266885 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.281166 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.281137 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv"] Jun 03 15:43:00.367672 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367623 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605527c8-eded-4627-9588-a523bbac42dd-service-ca-bundle\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.367672 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367673 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367696 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7292a296-6dcd-4b8d-873c-ce85ce1c570d-serving-cert\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367717 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/605527c8-eded-4627-9588-a523bbac42dd-tmp\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367737 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-certificates\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367767 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7292a296-6dcd-4b8d-873c-ce85ce1c570d-trusted-ca\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367795 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/605527c8-eded-4627-9588-a523bbac42dd-serving-cert\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5842ae88-433c-4c34-8c6e-de0393c9ccdf-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367854 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-bound-sa-token\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367881 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-installation-pull-secrets\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367909 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7292a296-6dcd-4b8d-873c-ce85ce1c570d-config\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.367953 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.367953 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/659b5abc-2d68-4624-bcef-ddf3411e0512-ca-trust-extracted\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368022 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605527c8-eded-4627-9588-a523bbac42dd-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lgn\" (UniqueName: \"kubernetes.io/projected/5842ae88-433c-4c34-8c6e-de0393c9ccdf-kube-api-access-b2lgn\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368134 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b52ms\" (UniqueName: \"kubernetes.io/projected/7292a296-6dcd-4b8d-873c-ce85ce1c570d-kube-api-access-b52ms\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368153 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/605527c8-eded-4627-9588-a523bbac42dd-tmp\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368163 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwgvf\" (UniqueName: \"kubernetes.io/projected/605527c8-eded-4627-9588-a523bbac42dd-kube-api-access-gwgvf\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368203 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-image-registry-private-configuration\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368243 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/605527c8-eded-4627-9588-a523bbac42dd-snapshots\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368274 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-trusted-ca\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368300 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j88jm\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-kube-api-access-j88jm\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368349 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605527c8-eded-4627-9588-a523bbac42dd-service-ca-bundle\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.368499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368378 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-certificates\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.369089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368775 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7292a296-6dcd-4b8d-873c-ce85ce1c570d-trusted-ca\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.369089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.368996 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/605527c8-eded-4627-9588-a523bbac42dd-snapshots\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.369544 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.367881 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:43:00.369544 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.369279 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f5d94b9-tjsdn: secret "image-registry-tls" not found Jun 03 15:43:00.369544 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.369339 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls podName:659b5abc-2d68-4624-bcef-ddf3411e0512 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:00.869320952 +0000 UTC m=+132.865620065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls") pod "image-registry-559f5d94b9-tjsdn" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512") : secret "image-registry-tls" not found Jun 03 15:43:00.369544 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.369427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605527c8-eded-4627-9588-a523bbac42dd-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.369544 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.369500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/659b5abc-2d68-4624-bcef-ddf3411e0512-ca-trust-extracted\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.369866 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.369584 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7292a296-6dcd-4b8d-873c-ce85ce1c570d-config\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.369866 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.369727 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-trusted-ca\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.370571 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.370543 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7292a296-6dcd-4b8d-873c-ce85ce1c570d-serving-cert\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.370855 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.370836 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/605527c8-eded-4627-9588-a523bbac42dd-serving-cert\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.370969 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.370953 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-image-registry-private-configuration\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.371588 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.371573 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-installation-pull-secrets\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.388129 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.388089 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j88jm\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-kube-api-access-j88jm\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.388273 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.388171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-bound-sa-token\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.388428 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.388409 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwgvf\" (UniqueName: \"kubernetes.io/projected/605527c8-eded-4627-9588-a523bbac42dd-kube-api-access-gwgvf\") pod \"insights-operator-788bf58df5-54mdl\" (UID: \"605527c8-eded-4627-9588-a523bbac42dd\") " pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.389512 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.389491 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b52ms\" (UniqueName: \"kubernetes.io/projected/7292a296-6dcd-4b8d-873c-ce85ce1c570d-kube-api-access-b52ms\") pod \"console-operator-86d7c6cc77-nhfqn\" (UID: \"7292a296-6dcd-4b8d-873c-ce85ce1c570d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.468962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.468904 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5842ae88-433c-4c34-8c6e-de0393c9ccdf-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.469126 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.469013 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lgn\" (UniqueName: \"kubernetes.io/projected/5842ae88-433c-4c34-8c6e-de0393c9ccdf-kube-api-access-b2lgn\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.469126 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.469054 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.469214 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.469182 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:00.469272 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.469258 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls podName:5842ae88-433c-4c34-8c6e-de0393c9ccdf nodeName:}" failed. No retries permitted until 2026-06-03 15:43:00.969238277 +0000 UTC m=+132.965537401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-znrdv" (UID: "5842ae88-433c-4c34-8c6e-de0393c9ccdf") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:00.469755 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.469735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5842ae88-433c-4c34-8c6e-de0393c9ccdf-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.482581 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.482548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lgn\" (UniqueName: \"kubernetes.io/projected/5842ae88-433c-4c34-8c6e-de0393c9ccdf-kube-api-access-b2lgn\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.490546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.490519 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:00.496342 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.496320 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-54mdl" Jun 03 15:43:00.639008 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.638970 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-nhfqn"] Jun 03 15:43:00.644001 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:00.643968 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7292a296_6dcd_4b8d_873c_ce85ce1c570d.slice/crio-a36eaea5c28ca5b30d837513e873f1fbeb0d283a6833341406d51176e4b77a98 WatchSource:0}: Error finding container a36eaea5c28ca5b30d837513e873f1fbeb0d283a6833341406d51176e4b77a98: Status 404 returned error can't find the container with id a36eaea5c28ca5b30d837513e873f1fbeb0d283a6833341406d51176e4b77a98 Jun 03 15:43:00.654114 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.654083 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-54mdl"] Jun 03 15:43:00.658843 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:00.658815 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605527c8_eded_4627_9588_a523bbac42dd.slice/crio-610db4cd9f9385ecc1d065fb7494b82403372863f50c92ca927c2d6d433112bb WatchSource:0}: Error finding container 610db4cd9f9385ecc1d065fb7494b82403372863f50c92ca927c2d6d433112bb: Status 404 returned error can't find the container with id 610db4cd9f9385ecc1d065fb7494b82403372863f50c92ca927c2d6d433112bb Jun 03 15:43:00.872252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.872156 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:00.872405 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.872327 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:43:00.872405 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.872354 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f5d94b9-tjsdn: secret "image-registry-tls" not found Jun 03 15:43:00.872484 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.872417 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls podName:659b5abc-2d68-4624-bcef-ddf3411e0512 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:01.872401019 +0000 UTC m=+133.868700131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls") pod "image-registry-559f5d94b9-tjsdn" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512") : secret "image-registry-tls" not found Jun 03 15:43:00.878438 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.878403 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" event={"ID":"7292a296-6dcd-4b8d-873c-ce85ce1c570d","Type":"ContainerStarted","Data":"a36eaea5c28ca5b30d837513e873f1fbeb0d283a6833341406d51176e4b77a98"} Jun 03 15:43:00.879355 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.879329 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-54mdl" event={"ID":"605527c8-eded-4627-9588-a523bbac42dd","Type":"ContainerStarted","Data":"610db4cd9f9385ecc1d065fb7494b82403372863f50c92ca927c2d6d433112bb"} Jun 03 15:43:00.972869 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:00.972809 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:00.973079 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.972984 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:00.973079 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:00.973049 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls podName:5842ae88-433c-4c34-8c6e-de0393c9ccdf nodeName:}" failed. No retries permitted until 2026-06-03 15:43:01.973033601 +0000 UTC m=+133.969332706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-znrdv" (UID: "5842ae88-433c-4c34-8c6e-de0393c9ccdf") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:01.790553 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.790510 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9"] Jun 03 15:43:01.794424 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.794383 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:01.798889 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.798850 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 15:43:01.801136 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.801113 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:43:01.802397 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.802311 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 15:43:01.802607 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.802581 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 15:43:01.803304 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.803282 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5x957\"" Jun 03 15:43:01.817366 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.817325 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9"] Jun 03 15:43:01.879717 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.879667 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:01.879915 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.879727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e0e2194-6372-40c3-b5ce-c36bbf309917-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-zfmn9\" (UID: \"6e0e2194-6372-40c3-b5ce-c36bbf309917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:01.879915 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.879755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7n94\" (UniqueName: \"kubernetes.io/projected/6e0e2194-6372-40c3-b5ce-c36bbf309917-kube-api-access-q7n94\") pod \"kube-storage-version-migrator-operator-96ddc787c-zfmn9\" (UID: \"6e0e2194-6372-40c3-b5ce-c36bbf309917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:01.879915 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:01.879838 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:43:01.879915 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:01.879861 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f5d94b9-tjsdn: secret "image-registry-tls" not found Jun 03 15:43:01.879915 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.879858 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e0e2194-6372-40c3-b5ce-c36bbf309917-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-zfmn9\" (UID: \"6e0e2194-6372-40c3-b5ce-c36bbf309917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:01.880194 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:01.879923 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls podName:659b5abc-2d68-4624-bcef-ddf3411e0512 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:03.87990143 +0000 UTC m=+135.876200540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls") pod "image-registry-559f5d94b9-tjsdn" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512") : secret "image-registry-tls" not found Jun 03 15:43:01.980517 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.980478 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e0e2194-6372-40c3-b5ce-c36bbf309917-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-zfmn9\" (UID: \"6e0e2194-6372-40c3-b5ce-c36bbf309917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:01.980708 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.980581 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:01.980708 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.980650 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e0e2194-6372-40c3-b5ce-c36bbf309917-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-zfmn9\" (UID: \"6e0e2194-6372-40c3-b5ce-c36bbf309917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:01.980708 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:01.980675 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:01.980864 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:01.980745 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls podName:5842ae88-433c-4c34-8c6e-de0393c9ccdf nodeName:}" failed. No retries permitted until 2026-06-03 15:43:03.980726438 +0000 UTC m=+135.977025563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-znrdv" (UID: "5842ae88-433c-4c34-8c6e-de0393c9ccdf") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:01.980979 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.980675 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7n94\" (UniqueName: \"kubernetes.io/projected/6e0e2194-6372-40c3-b5ce-c36bbf309917-kube-api-access-q7n94\") pod \"kube-storage-version-migrator-operator-96ddc787c-zfmn9\" (UID: \"6e0e2194-6372-40c3-b5ce-c36bbf309917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:01.981551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.981522 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e0e2194-6372-40c3-b5ce-c36bbf309917-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-zfmn9\" (UID: \"6e0e2194-6372-40c3-b5ce-c36bbf309917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:01.983849 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.983821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e0e2194-6372-40c3-b5ce-c36bbf309917-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-zfmn9\" (UID: \"6e0e2194-6372-40c3-b5ce-c36bbf309917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:01.994974 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:01.994918 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7n94\" (UniqueName: \"kubernetes.io/projected/6e0e2194-6372-40c3-b5ce-c36bbf309917-kube-api-access-q7n94\") pod \"kube-storage-version-migrator-operator-96ddc787c-zfmn9\" (UID: \"6e0e2194-6372-40c3-b5ce-c36bbf309917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:02.107773 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:02.107689 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" Jun 03 15:43:02.256958 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:02.256907 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9"] Jun 03 15:43:02.259547 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:02.259516 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0e2194_6372_40c3_b5ce_c36bbf309917.slice/crio-98e152a3c1df342d4bbd58044016cad6f13f18136f3100e215c271f3d4576dc4 WatchSource:0}: Error finding container 98e152a3c1df342d4bbd58044016cad6f13f18136f3100e215c271f3d4576dc4: Status 404 returned error can't find the container with id 98e152a3c1df342d4bbd58044016cad6f13f18136f3100e215c271f3d4576dc4 Jun 03 15:43:02.885828 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:02.885788 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" event={"ID":"6e0e2194-6372-40c3-b5ce-c36bbf309917","Type":"ContainerStarted","Data":"98e152a3c1df342d4bbd58044016cad6f13f18136f3100e215c271f3d4576dc4"} Jun 03 15:43:03.889955 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:03.889854 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/0.log" Jun 03 15:43:03.889955 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:03.889896 2566 generic.go:358] "Generic (PLEG): container finished" podID="7292a296-6dcd-4b8d-873c-ce85ce1c570d" containerID="0b36e40147bb3855d1ee387b3c0f5b8affb28210fc8221258263e8efa861eb2d" exitCode=255 Jun 03 15:43:03.890435 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:03.889982 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" event={"ID":"7292a296-6dcd-4b8d-873c-ce85ce1c570d","Type":"ContainerDied","Data":"0b36e40147bb3855d1ee387b3c0f5b8affb28210fc8221258263e8efa861eb2d"} Jun 03 15:43:03.890435 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:03.890270 2566 scope.go:117] "RemoveContainer" containerID="0b36e40147bb3855d1ee387b3c0f5b8affb28210fc8221258263e8efa861eb2d" Jun 03 15:43:03.891557 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:03.891530 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-54mdl" event={"ID":"605527c8-eded-4627-9588-a523bbac42dd","Type":"ContainerStarted","Data":"b9b69508ddfa942198626fa925b508e16d5fa9e378b481d575e2366fcabbdc28"} Jun 03 15:43:03.899638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:03.899607 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:03.899768 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:03.899751 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:43:03.899829 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:03.899772 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f5d94b9-tjsdn: secret "image-registry-tls" not found Jun 03 15:43:03.899919 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:03.899842 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls podName:659b5abc-2d68-4624-bcef-ddf3411e0512 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:07.899819587 +0000 UTC m=+139.896118712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls") pod "image-registry-559f5d94b9-tjsdn" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512") : secret "image-registry-tls" not found Jun 03 15:43:03.949529 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:03.949471 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-54mdl" podStartSLOduration=1.011031711 podStartE2EDuration="3.949453275s" podCreationTimestamp="2026-06-03 15:43:00 +0000 UTC" firstStartedPulling="2026-06-03 15:43:00.660796761 +0000 UTC m=+132.657095866" lastFinishedPulling="2026-06-03 15:43:03.599218309 +0000 UTC m=+135.595517430" observedRunningTime="2026-06-03 15:43:03.949203081 +0000 UTC m=+135.945502209" watchObservedRunningTime="2026-06-03 15:43:03.949453275 +0000 UTC m=+135.945752401" Jun 03 15:43:04.001000 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.000958 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:04.002334 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:04.002302 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:04.002485 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:04.002385 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls podName:5842ae88-433c-4c34-8c6e-de0393c9ccdf nodeName:}" failed. No retries permitted until 2026-06-03 15:43:08.002361548 +0000 UTC m=+139.998660674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-znrdv" (UID: "5842ae88-433c-4c34-8c6e-de0393c9ccdf") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:04.896466 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.896409 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 15:43:04.897206 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.896867 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/0.log" Jun 03 15:43:04.897206 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.896956 2566 generic.go:358] "Generic (PLEG): container finished" podID="7292a296-6dcd-4b8d-873c-ce85ce1c570d" containerID="6f023eb0d7edf3025b279f4ddcd2d19b2f564db43fa8ad7bf7459421ac171f4b" exitCode=255 Jun 03 15:43:04.897206 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.897010 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" event={"ID":"7292a296-6dcd-4b8d-873c-ce85ce1c570d","Type":"ContainerDied","Data":"6f023eb0d7edf3025b279f4ddcd2d19b2f564db43fa8ad7bf7459421ac171f4b"} Jun 03 15:43:04.897206 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.897061 2566 scope.go:117] "RemoveContainer" containerID="0b36e40147bb3855d1ee387b3c0f5b8affb28210fc8221258263e8efa861eb2d" Jun 03 15:43:04.897471 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.897376 2566 scope.go:117] "RemoveContainer" containerID="6f023eb0d7edf3025b279f4ddcd2d19b2f564db43fa8ad7bf7459421ac171f4b" Jun 03 15:43:04.897612 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:04.897586 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-nhfqn_openshift-console-operator(7292a296-6dcd-4b8d-873c-ce85ce1c570d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" podUID="7292a296-6dcd-4b8d-873c-ce85ce1c570d" Jun 03 15:43:04.970206 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.970165 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-27db7"] Jun 03 15:43:04.973520 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.973499 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-27db7" Jun 03 15:43:04.978281 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.978255 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hqqf5\"" Jun 03 15:43:04.984811 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:04.984785 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-27db7"] Jun 03 15:43:05.112433 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.112388 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4h8v\" (UniqueName: \"kubernetes.io/projected/3301f57a-2156-4814-9d35-a2346c285c90-kube-api-access-w4h8v\") pod \"network-check-source-56d84b9f44-27db7\" (UID: \"3301f57a-2156-4814-9d35-a2346c285c90\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-27db7" Jun 03 15:43:05.213843 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.213799 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4h8v\" (UniqueName: \"kubernetes.io/projected/3301f57a-2156-4814-9d35-a2346c285c90-kube-api-access-w4h8v\") pod \"network-check-source-56d84b9f44-27db7\" (UID: \"3301f57a-2156-4814-9d35-a2346c285c90\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-27db7" Jun 03 15:43:05.225906 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.225878 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4h8v\" (UniqueName: \"kubernetes.io/projected/3301f57a-2156-4814-9d35-a2346c285c90-kube-api-access-w4h8v\") pod \"network-check-source-56d84b9f44-27db7\" (UID: \"3301f57a-2156-4814-9d35-a2346c285c90\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-27db7" Jun 03 15:43:05.281881 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.281838 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-27db7" Jun 03 15:43:05.670172 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.670136 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-27db7"] Jun 03 15:43:05.673859 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:05.673823 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3301f57a_2156_4814_9d35_a2346c285c90.slice/crio-5bb7a36814e6307bef0be5f4249fd24895707d6fc6b1b6c9a8adb0fb8c87c2e5 WatchSource:0}: Error finding container 5bb7a36814e6307bef0be5f4249fd24895707d6fc6b1b6c9a8adb0fb8c87c2e5: Status 404 returned error can't find the container with id 5bb7a36814e6307bef0be5f4249fd24895707d6fc6b1b6c9a8adb0fb8c87c2e5 Jun 03 15:43:05.901457 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.901355 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-27db7" event={"ID":"3301f57a-2156-4814-9d35-a2346c285c90","Type":"ContainerStarted","Data":"06c11c6faea70303ca6dc0bbc96e59c38234cbc1598865315de7cdfeed3801a0"} Jun 03 15:43:05.901457 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.901397 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-27db7" event={"ID":"3301f57a-2156-4814-9d35-a2346c285c90","Type":"ContainerStarted","Data":"5bb7a36814e6307bef0be5f4249fd24895707d6fc6b1b6c9a8adb0fb8c87c2e5"} Jun 03 15:43:05.902807 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.902777 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" event={"ID":"6e0e2194-6372-40c3-b5ce-c36bbf309917","Type":"ContainerStarted","Data":"ffa04559f2f2047404fe091473dfd4d706624ad75e5be620feb589d9989a9b1e"} Jun 03 15:43:05.904252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.904235 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 15:43:05.904531 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.904518 2566 scope.go:117] "RemoveContainer" containerID="6f023eb0d7edf3025b279f4ddcd2d19b2f564db43fa8ad7bf7459421ac171f4b" Jun 03 15:43:05.904681 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:05.904663 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-nhfqn_openshift-console-operator(7292a296-6dcd-4b8d-873c-ce85ce1c570d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" podUID="7292a296-6dcd-4b8d-873c-ce85ce1c570d" Jun 03 15:43:05.925448 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.925399 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-27db7" podStartSLOduration=1.925384132 podStartE2EDuration="1.925384132s" podCreationTimestamp="2026-06-03 15:43:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:43:05.92477294 +0000 UTC m=+137.921072066" watchObservedRunningTime="2026-06-03 15:43:05.925384132 +0000 UTC m=+137.921683260" Jun 03 15:43:05.955265 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:05.955211 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" podStartSLOduration=1.633861843 podStartE2EDuration="4.955196564s" podCreationTimestamp="2026-06-03 15:43:01 +0000 UTC" firstStartedPulling="2026-06-03 15:43:02.261338422 +0000 UTC m=+134.257637527" lastFinishedPulling="2026-06-03 15:43:05.582673134 +0000 UTC m=+137.578972248" observedRunningTime="2026-06-03 15:43:05.954809111 +0000 UTC m=+137.951108238" watchObservedRunningTime="2026-06-03 15:43:05.955196564 +0000 UTC m=+137.951495692" Jun 03 15:43:06.953190 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:06.953157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wpptc_f6caefd0-80ba-43d7-b47c-a7906247a283/dns-node-resolver/0.log" Jun 03 15:43:07.938676 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:07.938605 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:07.938877 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:07.938780 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:43:07.938877 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:07.938797 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f5d94b9-tjsdn: secret "image-registry-tls" not found Jun 03 15:43:07.938877 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:07.938855 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls podName:659b5abc-2d68-4624-bcef-ddf3411e0512 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:15.938838779 +0000 UTC m=+147.935137906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls") pod "image-registry-559f5d94b9-tjsdn" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512") : secret "image-registry-tls" not found Jun 03 15:43:07.961798 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:07.961771 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sz8cj_e5842307-e08e-42fb-8caa-896c72c2085a/node-ca/0.log" Jun 03 15:43:08.039589 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:08.039523 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:08.039791 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:08.039677 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:08.039791 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:08.039751 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls podName:5842ae88-433c-4c34-8c6e-de0393c9ccdf nodeName:}" failed. No retries permitted until 2026-06-03 15:43:16.039734606 +0000 UTC m=+148.036033711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-znrdv" (UID: "5842ae88-433c-4c34-8c6e-de0393c9ccdf") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:10.490666 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:10.490610 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:10.490666 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:10.490666 2566 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:10.491262 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:10.491173 2566 scope.go:117] "RemoveContainer" containerID="6f023eb0d7edf3025b279f4ddcd2d19b2f564db43fa8ad7bf7459421ac171f4b" Jun 03 15:43:10.491420 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:10.491397 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-nhfqn_openshift-console-operator(7292a296-6dcd-4b8d-873c-ce85ce1c570d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" podUID="7292a296-6dcd-4b8d-873c-ce85ce1c570d" Jun 03 15:43:16.001109 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:16.001066 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:16.001606 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:16.001236 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:43:16.001606 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:16.001262 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f5d94b9-tjsdn: secret "image-registry-tls" not found Jun 03 15:43:16.001606 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:16.001348 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls podName:659b5abc-2d68-4624-bcef-ddf3411e0512 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:32.001326225 +0000 UTC m=+163.997625347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls") pod "image-registry-559f5d94b9-tjsdn" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512") : secret "image-registry-tls" not found Jun 03 15:43:16.101731 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:16.101689 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:16.101957 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:16.101851 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:16.102029 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:16.101975 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls podName:5842ae88-433c-4c34-8c6e-de0393c9ccdf nodeName:}" failed. No retries permitted until 2026-06-03 15:43:32.101952492 +0000 UTC m=+164.098251601 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-znrdv" (UID: "5842ae88-433c-4c34-8c6e-de0393c9ccdf") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:43:25.539481 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:25.539445 2566 scope.go:117] "RemoveContainer" containerID="6f023eb0d7edf3025b279f4ddcd2d19b2f564db43fa8ad7bf7459421ac171f4b" Jun 03 15:43:25.956971 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:25.956945 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 15:43:25.957145 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:25.957022 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" event={"ID":"7292a296-6dcd-4b8d-873c-ce85ce1c570d","Type":"ContainerStarted","Data":"45bdf5cb29eb6e049fd4d5210211bd904370f77c78df87d99e53142fe659d500"} Jun 03 15:43:25.957348 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:25.957326 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:25.962354 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:25.962327 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lqvnf" podUID="b4d844ab-840b-4d1c-992a-0b6378488f99" Jun 03 15:43:25.979233 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:25.979184 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" podStartSLOduration=23.023880248 podStartE2EDuration="25.979169842s" podCreationTimestamp="2026-06-03 15:43:00 +0000 UTC" firstStartedPulling="2026-06-03 15:43:00.645772024 +0000 UTC m=+132.642071130" lastFinishedPulling="2026-06-03 15:43:03.601061616 +0000 UTC m=+135.597360724" observedRunningTime="2026-06-03 15:43:25.979069585 +0000 UTC m=+157.975368712" watchObservedRunningTime="2026-06-03 15:43:25.979169842 +0000 UTC m=+157.975468968" Jun 03 15:43:25.986293 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:25.986263 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-hkb6b" podUID="615a5ed6-3481-43be-bf62-2821574f286b" Jun 03 15:43:26.556513 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:26.556463 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r8tzl" podUID="ed7e5465-29a7-4ab3-b71f-305d11a1733e" Jun 03 15:43:26.863498 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:26.863405 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-nhfqn" Jun 03 15:43:26.959361 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:26.959330 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:43:26.959361 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:26.959329 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lqvnf" Jun 03 15:43:30.915668 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:30.915625 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:43:30.916127 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:30.915798 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:43:30.918145 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:30.918115 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4d844ab-840b-4d1c-992a-0b6378488f99-metrics-tls\") pod \"dns-default-lqvnf\" (UID: \"b4d844ab-840b-4d1c-992a-0b6378488f99\") " pod="openshift-dns/dns-default-lqvnf" Jun 03 15:43:30.918260 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:30.918241 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615a5ed6-3481-43be-bf62-2821574f286b-cert\") pod \"ingress-canary-hkb6b\" (UID: \"615a5ed6-3481-43be-bf62-2821574f286b\") " pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:43:31.164499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.164467 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2z9xs\"" Jun 03 15:43:31.164499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.164467 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f2mct\"" Jun 03 15:43:31.171041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.170981 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lqvnf" Jun 03 15:43:31.171101 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.171034 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkb6b" Jun 03 15:43:31.317745 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.317715 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lqvnf"] Jun 03 15:43:31.321105 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:31.321078 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d844ab_840b_4d1c_992a_0b6378488f99.slice/crio-e6a5b6cff7e491d0c2c59c4455cc9e27cf4fa9fbacd437e07dbcd277c28371b3 WatchSource:0}: Error finding container e6a5b6cff7e491d0c2c59c4455cc9e27cf4fa9fbacd437e07dbcd277c28371b3: Status 404 returned error can't find the container with id e6a5b6cff7e491d0c2c59c4455cc9e27cf4fa9fbacd437e07dbcd277c28371b3 Jun 03 15:43:31.331118 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.331090 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkb6b"] Jun 03 15:43:31.334770 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:31.334745 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615a5ed6_3481_43be_bf62_2821574f286b.slice/crio-8047dc59c3bf1441834f102877921bb0d32007cc30f4baba246fd2dc46f1edcf WatchSource:0}: Error finding container 8047dc59c3bf1441834f102877921bb0d32007cc30f4baba246fd2dc46f1edcf: Status 404 returned error can't find the container with id 8047dc59c3bf1441834f102877921bb0d32007cc30f4baba246fd2dc46f1edcf Jun 03 15:43:31.635130 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.635095 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-559f5d94b9-tjsdn"] Jun 03 15:43:31.635370 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:31.635348 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" podUID="659b5abc-2d68-4624-bcef-ddf3411e0512" Jun 03 15:43:31.712404 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.712364 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-scnr2"] Jun 03 15:43:31.714802 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.714775 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.720256 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.720223 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2w7fl\"" Jun 03 15:43:31.720540 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.720522 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 15:43:31.721008 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.720982 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 15:43:31.729109 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.729083 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-scnr2"] Jun 03 15:43:31.823510 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.823460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.823673 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.823515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.823673 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.823574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-data-volume\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.823796 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.823672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-crio-socket\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.823796 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.823704 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw97m\" (UniqueName: \"kubernetes.io/projected/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-kube-api-access-kw97m\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.924602 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.924265 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.924602 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.924410 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.924602 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.924471 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-data-volume\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.924602 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.924524 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-crio-socket\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.924602 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.924554 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kw97m\" (UniqueName: \"kubernetes.io/projected/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-kube-api-access-kw97m\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.925271 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.924691 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-crio-socket\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.925484 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.925461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.925707 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.925686 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-data-volume\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.927367 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.927328 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.936820 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.936787 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw97m\" (UniqueName: \"kubernetes.io/projected/9e2b4755-0c5b-4e79-ab6b-b24202ba2bad-kube-api-access-kw97m\") pod \"insights-runtime-extractor-scnr2\" (UID: \"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad\") " pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:31.976510 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.976469 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqvnf" event={"ID":"b4d844ab-840b-4d1c-992a-0b6378488f99","Type":"ContainerStarted","Data":"e6a5b6cff7e491d0c2c59c4455cc9e27cf4fa9fbacd437e07dbcd277c28371b3"} Jun 03 15:43:31.977774 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.977721 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkb6b" event={"ID":"615a5ed6-3481-43be-bf62-2821574f286b","Type":"ContainerStarted","Data":"8047dc59c3bf1441834f102877921bb0d32007cc30f4baba246fd2dc46f1edcf"} Jun 03 15:43:31.977774 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.977761 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:31.983460 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:31.983427 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:32.025801 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.025773 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j88jm\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-kube-api-access-j88jm\") pod \"659b5abc-2d68-4624-bcef-ddf3411e0512\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " Jun 03 15:43:32.026027 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.025864 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-certificates\") pod \"659b5abc-2d68-4624-bcef-ddf3411e0512\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " Jun 03 15:43:32.026027 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.025891 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-image-registry-private-configuration\") pod \"659b5abc-2d68-4624-bcef-ddf3411e0512\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " Jun 03 15:43:32.026027 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.025943 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-bound-sa-token\") pod \"659b5abc-2d68-4624-bcef-ddf3411e0512\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " Jun 03 15:43:32.026027 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.025984 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-installation-pull-secrets\") pod \"659b5abc-2d68-4624-bcef-ddf3411e0512\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " Jun 03 15:43:32.026351 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.026309 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "659b5abc-2d68-4624-bcef-ddf3411e0512" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:43:32.026478 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.026390 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-trusted-ca\") pod \"659b5abc-2d68-4624-bcef-ddf3411e0512\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " Jun 03 15:43:32.026478 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.026430 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/659b5abc-2d68-4624-bcef-ddf3411e0512-ca-trust-extracted\") pod \"659b5abc-2d68-4624-bcef-ddf3411e0512\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " Jun 03 15:43:32.026580 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.026487 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-scnr2" Jun 03 15:43:32.029132 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.029096 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "659b5abc-2d68-4624-bcef-ddf3411e0512" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:43:32.029239 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.029164 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/659b5abc-2d68-4624-bcef-ddf3411e0512-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "659b5abc-2d68-4624-bcef-ddf3411e0512" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:43:32.029315 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.029268 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "659b5abc-2d68-4624-bcef-ddf3411e0512" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:43:32.029369 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.029352 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "659b5abc-2d68-4624-bcef-ddf3411e0512" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:43:32.030551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.030038 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:32.030551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.030165 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-certificates\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:43:32.030551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.030182 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-image-registry-private-configuration\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:43:32.030551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.030197 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/659b5abc-2d68-4624-bcef-ddf3411e0512-installation-pull-secrets\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:43:32.030551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.030217 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/659b5abc-2d68-4624-bcef-ddf3411e0512-trusted-ca\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:43:32.030551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.030231 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/659b5abc-2d68-4624-bcef-ddf3411e0512-ca-trust-extracted\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:43:32.036774 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.036743 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "659b5abc-2d68-4624-bcef-ddf3411e0512" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:43:32.038224 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.038172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"image-registry-559f5d94b9-tjsdn\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:32.038457 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.038426 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-kube-api-access-j88jm" (OuterVolumeSpecName: "kube-api-access-j88jm") pod "659b5abc-2d68-4624-bcef-ddf3411e0512" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512"). InnerVolumeSpecName "kube-api-access-j88jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:43:32.130941 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.130885 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") pod \"659b5abc-2d68-4624-bcef-ddf3411e0512\" (UID: \"659b5abc-2d68-4624-bcef-ddf3411e0512\") " Jun 03 15:43:32.131178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.131154 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:32.131252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.131228 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-bound-sa-token\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:43:32.131252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.131243 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j88jm\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-kube-api-access-j88jm\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:43:32.133732 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.133696 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "659b5abc-2d68-4624-bcef-ddf3411e0512" (UID: "659b5abc-2d68-4624-bcef-ddf3411e0512"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:43:32.134419 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.134393 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5842ae88-433c-4c34-8c6e-de0393c9ccdf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-znrdv\" (UID: \"5842ae88-433c-4c34-8c6e-de0393c9ccdf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:32.232410 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.232369 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/659b5abc-2d68-4624-bcef-ddf3411e0512-registry-tls\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:43:32.245445 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.245389 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-scnr2"] Jun 03 15:43:32.249131 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:32.249069 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2b4755_0c5b_4e79_ab6b_b24202ba2bad.slice/crio-8cfdce0355bdcaee1527c57dc030a60da7060e63f04a8ed9cb4c7eebe3d4c59a WatchSource:0}: Error finding container 8cfdce0355bdcaee1527c57dc030a60da7060e63f04a8ed9cb4c7eebe3d4c59a: Status 404 returned error can't find the container with id 8cfdce0355bdcaee1527c57dc030a60da7060e63f04a8ed9cb4c7eebe3d4c59a Jun 03 15:43:32.368311 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.368275 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" Jun 03 15:43:32.821128 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.821033 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv"] Jun 03 15:43:32.983318 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.983270 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-scnr2" event={"ID":"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad","Type":"ContainerStarted","Data":"5072a2f5f385d021e0c9f744c1280f838779734b61763bce704cacc4accabe79"} Jun 03 15:43:32.983318 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.983322 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-scnr2" event={"ID":"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad","Type":"ContainerStarted","Data":"8cfdce0355bdcaee1527c57dc030a60da7060e63f04a8ed9cb4c7eebe3d4c59a"} Jun 03 15:43:32.983815 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:32.983353 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559f5d94b9-tjsdn" Jun 03 15:43:33.033209 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:33.033176 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-559f5d94b9-tjsdn"] Jun 03 15:43:33.043726 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:33.043690 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-559f5d94b9-tjsdn"] Jun 03 15:43:33.179397 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:33.179305 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5842ae88_433c_4c34_8c6e_de0393c9ccdf.slice/crio-d7d0227c3093936006f1a69d78d9c4631737921e9f21e8eda2e5a80aced84367 WatchSource:0}: Error finding container d7d0227c3093936006f1a69d78d9c4631737921e9f21e8eda2e5a80aced84367: Status 404 returned error can't find the container with id d7d0227c3093936006f1a69d78d9c4631737921e9f21e8eda2e5a80aced84367 Jun 03 15:43:33.987798 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:33.987757 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" event={"ID":"5842ae88-433c-4c34-8c6e-de0393c9ccdf","Type":"ContainerStarted","Data":"d7d0227c3093936006f1a69d78d9c4631737921e9f21e8eda2e5a80aced84367"} Jun 03 15:43:33.989234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:33.989198 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkb6b" event={"ID":"615a5ed6-3481-43be-bf62-2821574f286b","Type":"ContainerStarted","Data":"10e470cea473d7fefd08f4b13515ac11adf8ab89d84cd6db6e105fff7798edca"} Jun 03 15:43:33.991092 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:33.991067 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqvnf" event={"ID":"b4d844ab-840b-4d1c-992a-0b6378488f99","Type":"ContainerStarted","Data":"be5264344b1668a0330dd4bb5c9de49dcbbd50ae25ddd09c2813127a00f7666b"} Jun 03 15:43:33.991244 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:33.991100 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqvnf" event={"ID":"b4d844ab-840b-4d1c-992a-0b6378488f99","Type":"ContainerStarted","Data":"2339481e24b6a3a1fb940a2177ecfd5e8c587fd7866706eb3dc875ec9242634b"} Jun 03 15:43:33.991244 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:33.991205 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lqvnf" Jun 03 15:43:33.992639 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:33.992618 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-scnr2" event={"ID":"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad","Type":"ContainerStarted","Data":"5470d141f72ae63db3cf6539bc62034811b6bf685e110002fd10917a369dec3c"} Jun 03 15:43:34.012739 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:34.012687 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hkb6b" podStartSLOduration=130.119116634 podStartE2EDuration="2m12.012672552s" podCreationTimestamp="2026-06-03 15:41:22 +0000 UTC" firstStartedPulling="2026-06-03 15:43:31.33657763 +0000 UTC m=+163.332876736" lastFinishedPulling="2026-06-03 15:43:33.230133531 +0000 UTC m=+165.226432654" observedRunningTime="2026-06-03 15:43:34.011404951 +0000 UTC m=+166.007704092" watchObservedRunningTime="2026-06-03 15:43:34.012672552 +0000 UTC m=+166.008971679" Jun 03 15:43:34.046503 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:34.046454 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-lqvnf" podStartSLOduration=130.688594609 podStartE2EDuration="2m12.046438178s" podCreationTimestamp="2026-06-03 15:41:22 +0000 UTC" firstStartedPulling="2026-06-03 15:43:31.323315535 +0000 UTC m=+163.319614644" lastFinishedPulling="2026-06-03 15:43:32.681159098 +0000 UTC m=+164.677458213" observedRunningTime="2026-06-03 15:43:34.044384105 +0000 UTC m=+166.040683232" watchObservedRunningTime="2026-06-03 15:43:34.046438178 +0000 UTC m=+166.042737305" Jun 03 15:43:34.542405 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:34.542371 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="659b5abc-2d68-4624-bcef-ddf3411e0512" path="/var/lib/kubelet/pods/659b5abc-2d68-4624-bcef-ddf3411e0512/volumes" Jun 03 15:43:35.999403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:35.999369 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" event={"ID":"5842ae88-433c-4c34-8c6e-de0393c9ccdf","Type":"ContainerStarted","Data":"d04bacc328864c0be13183421753eebb93fba4a11ef8b911d9ba1b2fc214678d"} Jun 03 15:43:36.001169 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.001144 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-scnr2" event={"ID":"9e2b4755-0c5b-4e79-ab6b-b24202ba2bad","Type":"ContainerStarted","Data":"7b14eb6eb1fd1a16bca84ccb8abf02cb2056360f723d39b8b77204a33bca5e75"} Jun 03 15:43:36.022543 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.022488 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-znrdv" podStartSLOduration=33.687916277 podStartE2EDuration="36.022473307s" podCreationTimestamp="2026-06-03 15:43:00 +0000 UTC" firstStartedPulling="2026-06-03 15:43:33.183730844 +0000 UTC m=+165.180029966" lastFinishedPulling="2026-06-03 15:43:35.518287878 +0000 UTC m=+167.514586996" observedRunningTime="2026-06-03 15:43:36.021083206 +0000 UTC m=+168.017382334" watchObservedRunningTime="2026-06-03 15:43:36.022473307 +0000 UTC m=+168.018772462" Jun 03 15:43:36.053258 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.053201 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-scnr2" podStartSLOduration=2.22368744 podStartE2EDuration="5.05318402s" podCreationTimestamp="2026-06-03 15:43:31 +0000 UTC" firstStartedPulling="2026-06-03 15:43:32.690605243 +0000 UTC m=+164.686904355" lastFinishedPulling="2026-06-03 15:43:35.520101818 +0000 UTC m=+167.516400935" observedRunningTime="2026-06-03 15:43:36.052772369 +0000 UTC m=+168.049071497" watchObservedRunningTime="2026-06-03 15:43:36.05318402 +0000 UTC m=+168.049483146" Jun 03 15:43:36.146155 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.146072 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc"] Jun 03 15:43:36.148665 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.148648 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" Jun 03 15:43:36.150973 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.150944 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 15:43:36.151099 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.150995 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lplfn\"" Jun 03 15:43:36.160310 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.160286 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc"] Jun 03 15:43:36.265956 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.265845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a126e349-6a9c-4a45-8756-3296ce501c8b-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-pf2sc\" (UID: \"a126e349-6a9c-4a45-8756-3296ce501c8b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" Jun 03 15:43:36.366713 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.366676 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a126e349-6a9c-4a45-8756-3296ce501c8b-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-pf2sc\" (UID: \"a126e349-6a9c-4a45-8756-3296ce501c8b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" Jun 03 15:43:36.369125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.369095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a126e349-6a9c-4a45-8756-3296ce501c8b-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-pf2sc\" (UID: \"a126e349-6a9c-4a45-8756-3296ce501c8b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" Jun 03 15:43:36.457260 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.457199 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" Jun 03 15:43:36.593880 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:36.593843 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc"] Jun 03 15:43:36.597684 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:36.597656 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda126e349_6a9c_4a45_8756_3296ce501c8b.slice/crio-46b083e09e64a09082c5925e4c3aded61a2fed610dda2c6b28bd278185585b4f WatchSource:0}: Error finding container 46b083e09e64a09082c5925e4c3aded61a2fed610dda2c6b28bd278185585b4f: Status 404 returned error can't find the container with id 46b083e09e64a09082c5925e4c3aded61a2fed610dda2c6b28bd278185585b4f Jun 03 15:43:37.004993 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:37.004956 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" event={"ID":"a126e349-6a9c-4a45-8756-3296ce501c8b","Type":"ContainerStarted","Data":"46b083e09e64a09082c5925e4c3aded61a2fed610dda2c6b28bd278185585b4f"} Jun 03 15:43:37.006157 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:37.006135 2566 generic.go:358] "Generic (PLEG): container finished" podID="bca6318c-5a99-4d15-9818-18a2845930fc" containerID="d04d68852faf3213d26fdfb08d72e9156774e05eddcacb712e8e1c6186437a5c" exitCode=255 Jun 03 15:43:37.006248 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:37.006211 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" event={"ID":"bca6318c-5a99-4d15-9818-18a2845930fc","Type":"ContainerDied","Data":"d04d68852faf3213d26fdfb08d72e9156774e05eddcacb712e8e1c6186437a5c"} Jun 03 15:43:37.012574 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:37.012552 2566 scope.go:117] "RemoveContainer" containerID="d04d68852faf3213d26fdfb08d72e9156774e05eddcacb712e8e1c6186437a5c" Jun 03 15:43:38.010776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.010737 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" event={"ID":"a126e349-6a9c-4a45-8756-3296ce501c8b","Type":"ContainerStarted","Data":"13647796dc8e3257ca8b7174df650483aa5d628c22da175338ff3676b203e094"} Jun 03 15:43:38.011272 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.010902 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" Jun 03 15:43:38.012463 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.012429 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-556dd44754-f48c4" event={"ID":"bca6318c-5a99-4d15-9818-18a2845930fc","Type":"ContainerStarted","Data":"7acf396a7253de526aa23dbaf64f63e725337bd35c5eb3cec87f05865690a50a"} Jun 03 15:43:38.016394 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.016371 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" Jun 03 15:43:38.055202 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.055098 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-pf2sc" podStartSLOduration=0.849145691 podStartE2EDuration="2.055082467s" podCreationTimestamp="2026-06-03 15:43:36 +0000 UTC" firstStartedPulling="2026-06-03 15:43:36.599553787 +0000 UTC m=+168.595852893" lastFinishedPulling="2026-06-03 15:43:37.805490551 +0000 UTC m=+169.801789669" observedRunningTime="2026-06-03 15:43:38.042835217 +0000 UTC m=+170.039134343" watchObservedRunningTime="2026-06-03 15:43:38.055082467 +0000 UTC m=+170.051381594" Jun 03 15:43:38.055633 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.055614 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d69548986-jfnpt"] Jun 03 15:43:38.058728 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.058703 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.063378 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.063357 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 15:43:38.063656 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.063631 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 15:43:38.063793 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.063639 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 15:43:38.063793 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.063708 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 15:43:38.063793 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.063739 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 15:43:38.063793 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.063767 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 15:43:38.064075 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.063796 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 15:43:38.064075 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.063977 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wxcxx\"" Jun 03 15:43:38.075856 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.075816 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d69548986-jfnpt"] Jun 03 15:43:38.181242 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.181196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-oauth-serving-cert\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.181242 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.181242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-console-config\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.181470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.181299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-oauth-config\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.181470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.181379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-serving-cert\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.181470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.181400 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-service-ca\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.181470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.181460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ghkh\" (UniqueName: \"kubernetes.io/projected/9fb44424-1196-4c28-891c-da0878bbe451-kube-api-access-8ghkh\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.282291 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.282255 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-oauth-config\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.282291 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.282297 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-serving-cert\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.282470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.282314 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-service-ca\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.282470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.282448 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ghkh\" (UniqueName: \"kubernetes.io/projected/9fb44424-1196-4c28-891c-da0878bbe451-kube-api-access-8ghkh\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.282546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.282486 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-oauth-serving-cert\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.282546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.282525 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-console-config\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.283114 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.283084 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-service-ca\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.283234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.283145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-console-config\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.283303 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.283228 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-oauth-serving-cert\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.284901 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.284881 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-oauth-config\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.285006 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.284968 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-serving-cert\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.318546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.318460 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ghkh\" (UniqueName: \"kubernetes.io/projected/9fb44424-1196-4c28-891c-da0878bbe451-kube-api-access-8ghkh\") pod \"console-d69548986-jfnpt\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.368624 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.368579 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:38.512805 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.512773 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d69548986-jfnpt"] Jun 03 15:43:38.515832 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:38.515801 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb44424_1196_4c28_891c_da0878bbe451.slice/crio-7a64118f2678355a282e9c37c7b11144d02e3e803fe6577e50d316cfbb32c1f8 WatchSource:0}: Error finding container 7a64118f2678355a282e9c37c7b11144d02e3e803fe6577e50d316cfbb32c1f8: Status 404 returned error can't find the container with id 7a64118f2678355a282e9c37c7b11144d02e3e803fe6577e50d316cfbb32c1f8 Jun 03 15:43:38.543184 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:38.543151 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:43:39.016548 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.016502 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d69548986-jfnpt" event={"ID":"9fb44424-1196-4c28-891c-da0878bbe451","Type":"ContainerStarted","Data":"7a64118f2678355a282e9c37c7b11144d02e3e803fe6577e50d316cfbb32c1f8"} Jun 03 15:43:39.319228 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.319140 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp"] Jun 03 15:43:39.322308 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.322288 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.326411 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.326377 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 15:43:39.326579 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.326466 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5nb67\"" Jun 03 15:43:39.327275 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.327251 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 15:43:39.327400 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.327307 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:43:39.338866 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.338836 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp"] Jun 03 15:43:39.392943 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.392894 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.393143 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.393019 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6wpn\" (UniqueName: \"kubernetes.io/projected/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-kube-api-access-r6wpn\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.393143 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.393100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.393257 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.393145 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.493854 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.493784 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.493854 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.493867 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.494205 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.493912 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.494205 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:39.493965 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 15:43:39.494205 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.494017 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6wpn\" (UniqueName: \"kubernetes.io/projected/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-kube-api-access-r6wpn\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.494205 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:43:39.494041 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-prometheus-operator-tls podName:e35c390d-56c3-4e5d-818f-5bc65b5a53ab nodeName:}" failed. No retries permitted until 2026-06-03 15:43:39.994019999 +0000 UTC m=+171.990319104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-4j6cp" (UID: "e35c390d-56c3-4e5d-818f-5bc65b5a53ab") : secret "prometheus-operator-tls" not found Jun 03 15:43:39.494637 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.494616 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.496672 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.496651 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.513638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.513606 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6wpn\" (UniqueName: \"kubernetes.io/projected/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-kube-api-access-r6wpn\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:39.999009 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:39.998958 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:40.001390 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:40.001358 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e35c390d-56c3-4e5d-818f-5bc65b5a53ab-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-4j6cp\" (UID: \"e35c390d-56c3-4e5d-818f-5bc65b5a53ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:40.233495 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:40.233460 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" Jun 03 15:43:40.413271 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:40.413234 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp"] Jun 03 15:43:40.417266 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:40.417219 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35c390d_56c3_4e5d_818f_5bc65b5a53ab.slice/crio-420e96d25ad4bd267d7064785cf794e556f8ee852b8ce3019219be6d1fd0b489 WatchSource:0}: Error finding container 420e96d25ad4bd267d7064785cf794e556f8ee852b8ce3019219be6d1fd0b489: Status 404 returned error can't find the container with id 420e96d25ad4bd267d7064785cf794e556f8ee852b8ce3019219be6d1fd0b489 Jun 03 15:43:41.024467 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:41.024429 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" event={"ID":"e35c390d-56c3-4e5d-818f-5bc65b5a53ab","Type":"ContainerStarted","Data":"420e96d25ad4bd267d7064785cf794e556f8ee852b8ce3019219be6d1fd0b489"} Jun 03 15:43:43.030705 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:43.030656 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d69548986-jfnpt" event={"ID":"9fb44424-1196-4c28-891c-da0878bbe451","Type":"ContainerStarted","Data":"33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd"} Jun 03 15:43:43.032185 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:43.032155 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" event={"ID":"e35c390d-56c3-4e5d-818f-5bc65b5a53ab","Type":"ContainerStarted","Data":"305523d00ecb00969e2f6bd217d265041e81a5bd76d2d213fd20e1d1a6715746"} Jun 03 15:43:43.032304 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:43.032191 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" event={"ID":"e35c390d-56c3-4e5d-818f-5bc65b5a53ab","Type":"ContainerStarted","Data":"601c916babab37178646f6616359006da4d18413d8031d73e9db799b4700c86f"} Jun 03 15:43:43.056961 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:43.056891 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d69548986-jfnpt" podStartSLOduration=1.349520631 podStartE2EDuration="5.056876348s" podCreationTimestamp="2026-06-03 15:43:38 +0000 UTC" firstStartedPulling="2026-06-03 15:43:38.517616709 +0000 UTC m=+170.513915814" lastFinishedPulling="2026-06-03 15:43:42.224972418 +0000 UTC m=+174.221271531" observedRunningTime="2026-06-03 15:43:43.056177273 +0000 UTC m=+175.052476410" watchObservedRunningTime="2026-06-03 15:43:43.056876348 +0000 UTC m=+175.053175475" Jun 03 15:43:43.079776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:43.079728 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-4j6cp" podStartSLOduration=2.278107093 podStartE2EDuration="4.079711033s" podCreationTimestamp="2026-06-03 15:43:39 +0000 UTC" firstStartedPulling="2026-06-03 15:43:40.419880719 +0000 UTC m=+172.416179838" lastFinishedPulling="2026-06-03 15:43:42.22148466 +0000 UTC m=+174.217783778" observedRunningTime="2026-06-03 15:43:43.079676867 +0000 UTC m=+175.075975994" watchObservedRunningTime="2026-06-03 15:43:43.079711033 +0000 UTC m=+175.076010159" Jun 03 15:43:43.997481 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:43.997445 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lqvnf" Jun 03 15:43:44.760512 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.760477 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nsnpm"] Jun 03 15:43:44.762755 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.762728 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.764510 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.764488 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-g5kw5"] Jun 03 15:43:44.766315 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.766298 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.767906 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.767885 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-blgxq\"" Jun 03 15:43:44.767906 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.767899 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:43:44.768068 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.767942 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:43:44.768858 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.768839 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vltzh\"" Jun 03 15:43:44.768950 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.768860 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 15:43:44.769095 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.769079 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 15:43:44.773975 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.773956 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:43:44.781172 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.781148 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-75g7n"] Jun 03 15:43:44.783114 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.783099 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:44.788500 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.788478 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 15:43:44.790892 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.790874 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c8nqs\"" Jun 03 15:43:44.790892 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.790888 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 15:43:44.791026 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.790912 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 15:43:44.797394 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.797374 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-g5kw5"] Jun 03 15:43:44.809038 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.809006 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-75g7n"] Jun 03 15:43:44.843701 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.843667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-accelerators-collector-config\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.843888 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.843711 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3648816d-eac6-4a3c-9a42-dd8b3e759417-sys\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.843888 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.843742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3648816d-eac6-4a3c-9a42-dd8b3e759417-root\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.843888 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.843820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.843888 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.843863 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3648816d-eac6-4a3c-9a42-dd8b3e759417-metrics-client-ca\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.843888 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.843885 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecdb4b5a-2a0a-427f-9282-9d35016592ba-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.844125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.843907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-textfile\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.844125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.843955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-tls\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.844125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.843994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecdb4b5a-2a0a-427f-9282-9d35016592ba-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.844125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.844016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-wtmp\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.844125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.844045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9cr\" (UniqueName: \"kubernetes.io/projected/3648816d-eac6-4a3c-9a42-dd8b3e759417-kube-api-access-jm9cr\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.844125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.844061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecdb4b5a-2a0a-427f-9282-9d35016592ba-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.844125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.844089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6hcp\" (UniqueName: \"kubernetes.io/projected/ecdb4b5a-2a0a-427f-9282-9d35016592ba-kube-api-access-s6hcp\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.945158 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:44.945158 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:44.945380 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945206 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.945380 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945227 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3648816d-eac6-4a3c-9a42-dd8b3e759417-metrics-client-ca\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.945380 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945249 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecdb4b5a-2a0a-427f-9282-9d35016592ba-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.945541 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:44.945541 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945484 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-textfile\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.945541 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945522 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-tls\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.945686 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945549 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecdb4b5a-2a0a-427f-9282-9d35016592ba-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.945686 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:44.945686 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945621 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-wtmp\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.945829 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945694 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9cr\" (UniqueName: \"kubernetes.io/projected/3648816d-eac6-4a3c-9a42-dd8b3e759417-kube-api-access-jm9cr\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.945829 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945722 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecdb4b5a-2a0a-427f-9282-9d35016592ba-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.945829 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945751 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6hcp\" (UniqueName: \"kubernetes.io/projected/ecdb4b5a-2a0a-427f-9282-9d35016592ba-kube-api-access-s6hcp\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.945829 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945780 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-textfile\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.945829 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:44.945829 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945751 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-wtmp\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.947864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.946495 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3648816d-eac6-4a3c-9a42-dd8b3e759417-metrics-client-ca\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.947864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.945862 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-accelerators-collector-config\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.947864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.946580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkkm\" (UniqueName: \"kubernetes.io/projected/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-api-access-phkkm\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:44.947864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.946646 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3648816d-eac6-4a3c-9a42-dd8b3e759417-sys\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.947864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.946718 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3648816d-eac6-4a3c-9a42-dd8b3e759417-root\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.947864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.946835 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3648816d-eac6-4a3c-9a42-dd8b3e759417-root\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.947864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.946990 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3648816d-eac6-4a3c-9a42-dd8b3e759417-sys\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.947864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.946988 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecdb4b5a-2a0a-427f-9282-9d35016592ba-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.947864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.947788 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-accelerators-collector-config\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.948358 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.948261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-tls\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.948358 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.948283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3648816d-eac6-4a3c-9a42-dd8b3e759417-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.952643 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.952575 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecdb4b5a-2a0a-427f-9282-9d35016592ba-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.952774 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.952699 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecdb4b5a-2a0a-427f-9282-9d35016592ba-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:44.967353 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.967321 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9cr\" (UniqueName: \"kubernetes.io/projected/3648816d-eac6-4a3c-9a42-dd8b3e759417-kube-api-access-jm9cr\") pod \"node-exporter-nsnpm\" (UID: \"3648816d-eac6-4a3c-9a42-dd8b3e759417\") " pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:44.967480 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:44.967352 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6hcp\" (UniqueName: \"kubernetes.io/projected/ecdb4b5a-2a0a-427f-9282-9d35016592ba-kube-api-access-s6hcp\") pod \"openshift-state-metrics-85658796db-g5kw5\" (UID: \"ecdb4b5a-2a0a-427f-9282-9d35016592ba\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:45.047812 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.047720 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.047812 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.047760 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phkkm\" (UniqueName: \"kubernetes.io/projected/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-api-access-phkkm\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.048083 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.047859 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.048083 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.047886 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.048083 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.047968 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.048083 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.048003 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.048348 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.048322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.048632 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.048610 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.048632 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.048627 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.050408 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.050382 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.050538 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.050384 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.065905 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.065871 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkkm\" (UniqueName: \"kubernetes.io/projected/8ab10f7f-20e6-4b70-9cfe-407aca3a6918-kube-api-access-phkkm\") pod \"kube-state-metrics-8469c486bb-75g7n\" (UID: \"8ab10f7f-20e6-4b70-9cfe-407aca3a6918\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.073694 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.073668 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nsnpm" Jun 03 15:43:45.078441 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.078413 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" Jun 03 15:43:45.084125 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:45.084092 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3648816d_eac6_4a3c_9a42_dd8b3e759417.slice/crio-bc7eb132f1e5518335641d44c1b65f23c670e53199a2b8a6fd499aa24eab4b62 WatchSource:0}: Error finding container bc7eb132f1e5518335641d44c1b65f23c670e53199a2b8a6fd499aa24eab4b62: Status 404 returned error can't find the container with id bc7eb132f1e5518335641d44c1b65f23c670e53199a2b8a6fd499aa24eab4b62 Jun 03 15:43:45.091275 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.091247 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" Jun 03 15:43:45.250624 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.250594 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-g5kw5"] Jun 03 15:43:45.253588 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:45.253555 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdb4b5a_2a0a_427f_9282_9d35016592ba.slice/crio-21c14d07cbb4c779d022c694489899e97106dacd13ee61dd3e5a9b4d77a5df01 WatchSource:0}: Error finding container 21c14d07cbb4c779d022c694489899e97106dacd13ee61dd3e5a9b4d77a5df01: Status 404 returned error can't find the container with id 21c14d07cbb4c779d022c694489899e97106dacd13ee61dd3e5a9b4d77a5df01 Jun 03 15:43:45.271370 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.271347 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-75g7n"] Jun 03 15:43:45.282102 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:45.282063 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab10f7f_20e6_4b70_9cfe_407aca3a6918.slice/crio-f6ee32e2499c61df22bba7a7695afd1115c7f00b4a57739c5e91a188f2fa6edd WatchSource:0}: Error finding container f6ee32e2499c61df22bba7a7695afd1115c7f00b4a57739c5e91a188f2fa6edd: Status 404 returned error can't find the container with id f6ee32e2499c61df22bba7a7695afd1115c7f00b4a57739c5e91a188f2fa6edd Jun 03 15:43:45.800575 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.800534 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:43:45.804022 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.803994 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.808758 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.808457 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c45vv\"" Jun 03 15:43:45.808922 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.808815 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 15:43:45.808922 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.808855 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 15:43:45.808922 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.808903 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 15:43:45.809111 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.808833 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 15:43:45.809111 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.808852 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 15:43:45.809111 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.809105 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 15:43:45.810272 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.809369 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 15:43:45.810272 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.809486 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 15:43:45.810272 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.809730 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 15:43:45.824739 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.824710 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956403 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956598 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-out\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-volume\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956771 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956806 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-web-config\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956946 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:45.965178 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:45.956979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8czs6\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-kube-api-access-8czs6\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.043625 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.043587 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nsnpm" event={"ID":"3648816d-eac6-4a3c-9a42-dd8b3e759417","Type":"ContainerStarted","Data":"bc7eb132f1e5518335641d44c1b65f23c670e53199a2b8a6fd499aa24eab4b62"} Jun 03 15:43:46.045821 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.045159 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" event={"ID":"8ab10f7f-20e6-4b70-9cfe-407aca3a6918","Type":"ContainerStarted","Data":"f6ee32e2499c61df22bba7a7695afd1115c7f00b4a57739c5e91a188f2fa6edd"} Jun 03 15:43:46.047542 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.047507 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" event={"ID":"ecdb4b5a-2a0a-427f-9282-9d35016592ba","Type":"ContainerStarted","Data":"a17634906b5d83f4e72ab366333018398cf57dd28730ec41fd30f096e164635b"} Jun 03 15:43:46.047691 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.047549 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" event={"ID":"ecdb4b5a-2a0a-427f-9282-9d35016592ba","Type":"ContainerStarted","Data":"65c2e6488a75918bf2f3a2a5af28a194bf30eb8642b15af1327fba9087890a32"} Jun 03 15:43:46.047691 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.047563 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" event={"ID":"ecdb4b5a-2a0a-427f-9282-9d35016592ba","Type":"ContainerStarted","Data":"21c14d07cbb4c779d022c694489899e97106dacd13ee61dd3e5a9b4d77a5df01"} Jun 03 15:43:46.058630 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058551 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.058776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058645 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-out\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.058776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058684 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-volume\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.058776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058701 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.058776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058719 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.058776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058741 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.058776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058756 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.058776 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058774 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-web-config\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.059150 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058801 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.059150 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058818 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.059150 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058837 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8czs6\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-kube-api-access-8czs6\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.059150 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058856 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.059150 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.058871 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.060502 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.060328 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.060691 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.060657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.061890 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.061810 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.066562 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.066536 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.067706 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.066821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-out\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.067706 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.067261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-web-config\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.067706 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.067277 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.067706 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.067645 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.069021 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.068382 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.069547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.069493 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.069739 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.069700 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8czs6\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-kube-api-access-8czs6\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.069871 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.069833 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-volume\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.071001 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.070981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:46.118778 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:46.118736 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:43:47.053100 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:47.053043 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" event={"ID":"8ab10f7f-20e6-4b70-9cfe-407aca3a6918","Type":"ContainerStarted","Data":"346fe39beb43b03a982c9ac2b5eacf35648b6dcce4ec5f7dc05d9f394bdbb9af"} Jun 03 15:43:47.062711 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:47.062462 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" event={"ID":"ecdb4b5a-2a0a-427f-9282-9d35016592ba","Type":"ContainerStarted","Data":"438e3b5eb8106ad5eaa66bd10ff9febf0ae5a65f63f58513bcbb832b7a81bda7"} Jun 03 15:43:47.064578 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:47.064533 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nsnpm" event={"ID":"3648816d-eac6-4a3c-9a42-dd8b3e759417","Type":"ContainerStarted","Data":"3bad3575e45a7e1508375b81c16ef43ce78d7a27e23ff1909c39d5d9e6886c32"} Jun 03 15:43:47.098161 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:47.098107 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-g5kw5" podStartSLOduration=1.5610360669999999 podStartE2EDuration="3.098087988s" podCreationTimestamp="2026-06-03 15:43:44 +0000 UTC" firstStartedPulling="2026-06-03 15:43:45.384025235 +0000 UTC m=+177.380324340" lastFinishedPulling="2026-06-03 15:43:46.921077141 +0000 UTC m=+178.917376261" observedRunningTime="2026-06-03 15:43:47.096340324 +0000 UTC m=+179.092639455" watchObservedRunningTime="2026-06-03 15:43:47.098087988 +0000 UTC m=+179.094387117" Jun 03 15:43:47.116814 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:47.116783 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:43:47.176575 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:47.176539 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d6b901_64fa_4d5c_85d5_d63a5db53acc.slice/crio-8a6ae6a6494d287634183286b90702370d4114f2b52af0e653be270a221ced9a WatchSource:0}: Error finding container 8a6ae6a6494d287634183286b90702370d4114f2b52af0e653be270a221ced9a: Status 404 returned error can't find the container with id 8a6ae6a6494d287634183286b90702370d4114f2b52af0e653be270a221ced9a Jun 03 15:43:48.072521 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:48.072477 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" event={"ID":"8ab10f7f-20e6-4b70-9cfe-407aca3a6918","Type":"ContainerStarted","Data":"e14da0ed1817f891e3227f9da916273612eb740fa0d64e7afefccd0fcd89b431"} Jun 03 15:43:48.073098 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:48.072529 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" event={"ID":"8ab10f7f-20e6-4b70-9cfe-407aca3a6918","Type":"ContainerStarted","Data":"3e66e8a5253e55dd66249088aecb5eeaf8364d24c4c60fc7c593a331dddd7bf8"} Jun 03 15:43:48.074128 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:48.074098 2566 generic.go:358] "Generic (PLEG): container finished" podID="3648816d-eac6-4a3c-9a42-dd8b3e759417" containerID="3bad3575e45a7e1508375b81c16ef43ce78d7a27e23ff1909c39d5d9e6886c32" exitCode=0 Jun 03 15:43:48.074251 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:48.074191 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nsnpm" event={"ID":"3648816d-eac6-4a3c-9a42-dd8b3e759417","Type":"ContainerDied","Data":"3bad3575e45a7e1508375b81c16ef43ce78d7a27e23ff1909c39d5d9e6886c32"} Jun 03 15:43:48.075527 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:48.075498 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerStarted","Data":"8a6ae6a6494d287634183286b90702370d4114f2b52af0e653be270a221ced9a"} Jun 03 15:43:48.111285 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:48.111237 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-75g7n" podStartSLOduration=2.471179737 podStartE2EDuration="4.111220778s" podCreationTimestamp="2026-06-03 15:43:44 +0000 UTC" firstStartedPulling="2026-06-03 15:43:45.283996747 +0000 UTC m=+177.280295855" lastFinishedPulling="2026-06-03 15:43:46.924037776 +0000 UTC m=+178.920336896" observedRunningTime="2026-06-03 15:43:48.110066535 +0000 UTC m=+180.106365662" watchObservedRunningTime="2026-06-03 15:43:48.111220778 +0000 UTC m=+180.107519905" Jun 03 15:43:48.377320 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:48.373619 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:48.377320 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:48.375984 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:48.392398 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:48.392349 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:49.080332 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.080293 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nsnpm" event={"ID":"3648816d-eac6-4a3c-9a42-dd8b3e759417","Type":"ContainerStarted","Data":"0b9895302cad3d10b4918400d17f7b2e8c1932af42939890e2157c43eeb83151"} Jun 03 15:43:49.080748 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.080337 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nsnpm" event={"ID":"3648816d-eac6-4a3c-9a42-dd8b3e759417","Type":"ContainerStarted","Data":"a0eadb5974b4c5992460b5189d9617503e88b908f3b4330a8c1904d5aec588ab"} Jun 03 15:43:49.081686 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.081659 2566 generic.go:358] "Generic (PLEG): container finished" podID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerID="4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c" exitCode=0 Jun 03 15:43:49.081807 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.081744 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerDied","Data":"4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c"} Jun 03 15:43:49.085948 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.085915 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:43:49.122290 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.122233 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nsnpm" podStartSLOduration=3.288131292 podStartE2EDuration="5.122215159s" podCreationTimestamp="2026-06-03 15:43:44 +0000 UTC" firstStartedPulling="2026-06-03 15:43:45.08575823 +0000 UTC m=+177.082057336" lastFinishedPulling="2026-06-03 15:43:46.919842086 +0000 UTC m=+178.916141203" observedRunningTime="2026-06-03 15:43:49.117863128 +0000 UTC m=+181.114162256" watchObservedRunningTime="2026-06-03 15:43:49.122215159 +0000 UTC m=+181.118514374" Jun 03 15:43:49.371585 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.371505 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8ccd54697-p5h52"] Jun 03 15:43:49.374997 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.374976 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.378491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.378430 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-32suqbbtlvflv\"" Jun 03 15:43:49.378628 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.378556 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 15:43:49.378720 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.378689 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 15:43:49.378783 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.378767 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jkgms\"" Jun 03 15:43:49.381252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.381231 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 15:43:49.382041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.382026 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 15:43:49.396577 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.396555 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8ccd54697-p5h52"] Jun 03 15:43:49.505342 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.505306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/85097c10-4cab-4346-9f20-84b24bec2118-audit-log\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.505342 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.505344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/85097c10-4cab-4346-9f20-84b24bec2118-metrics-server-audit-profiles\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.505559 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.505365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85097c10-4cab-4346-9f20-84b24bec2118-client-ca-bundle\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.505559 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.505474 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/85097c10-4cab-4346-9f20-84b24bec2118-secret-metrics-server-tls\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.505559 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.505504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/85097c10-4cab-4346-9f20-84b24bec2118-secret-metrics-server-client-certs\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.505559 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.505534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw78b\" (UniqueName: \"kubernetes.io/projected/85097c10-4cab-4346-9f20-84b24bec2118-kube-api-access-xw78b\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.505694 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.505620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85097c10-4cab-4346-9f20-84b24bec2118-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.606212 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.606171 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85097c10-4cab-4346-9f20-84b24bec2118-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.606398 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.606237 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/85097c10-4cab-4346-9f20-84b24bec2118-audit-log\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.606398 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.606260 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/85097c10-4cab-4346-9f20-84b24bec2118-metrics-server-audit-profiles\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.606398 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.606279 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85097c10-4cab-4346-9f20-84b24bec2118-client-ca-bundle\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.606398 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.606348 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/85097c10-4cab-4346-9f20-84b24bec2118-secret-metrics-server-tls\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.606398 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.606379 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/85097c10-4cab-4346-9f20-84b24bec2118-secret-metrics-server-client-certs\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.606631 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.606499 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xw78b\" (UniqueName: \"kubernetes.io/projected/85097c10-4cab-4346-9f20-84b24bec2118-kube-api-access-xw78b\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.606755 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.606730 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/85097c10-4cab-4346-9f20-84b24bec2118-audit-log\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.607135 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.607104 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85097c10-4cab-4346-9f20-84b24bec2118-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.607848 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.607809 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/85097c10-4cab-4346-9f20-84b24bec2118-metrics-server-audit-profiles\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.609542 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.609502 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85097c10-4cab-4346-9f20-84b24bec2118-client-ca-bundle\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.609628 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.609610 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/85097c10-4cab-4346-9f20-84b24bec2118-secret-metrics-server-client-certs\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.609696 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.609630 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/85097c10-4cab-4346-9f20-84b24bec2118-secret-metrics-server-tls\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.622710 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.622630 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw78b\" (UniqueName: \"kubernetes.io/projected/85097c10-4cab-4346-9f20-84b24bec2118-kube-api-access-xw78b\") pod \"metrics-server-8ccd54697-p5h52\" (UID: \"85097c10-4cab-4346-9f20-84b24bec2118\") " pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.686815 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.686779 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:43:49.824963 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:49.824835 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8ccd54697-p5h52"] Jun 03 15:43:49.827722 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:49.827691 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85097c10_4cab_4346_9f20_84b24bec2118.slice/crio-bb2b3309ac5bd0c2fced8d82d78aa62d0b5d83fa0307c2a5783de70418efb1d9 WatchSource:0}: Error finding container bb2b3309ac5bd0c2fced8d82d78aa62d0b5d83fa0307c2a5783de70418efb1d9: Status 404 returned error can't find the container with id bb2b3309ac5bd0c2fced8d82d78aa62d0b5d83fa0307c2a5783de70418efb1d9 Jun 03 15:43:50.087612 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.087569 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" event={"ID":"85097c10-4cab-4346-9f20-84b24bec2118","Type":"ContainerStarted","Data":"bb2b3309ac5bd0c2fced8d82d78aa62d0b5d83fa0307c2a5783de70418efb1d9"} Jun 03 15:43:50.180793 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.180758 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bf78b7d77-qqhc7"] Jun 03 15:43:50.186027 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.185992 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.189005 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.188981 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 15:43:50.190100 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.189517 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 15:43:50.190100 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.189642 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 15:43:50.190100 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.190089 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 15:43:50.191051 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.190639 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 15:43:50.191157 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.191083 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bq4ls\"" Jun 03 15:43:50.199035 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.199007 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 15:43:50.207113 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.207082 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bf78b7d77-qqhc7"] Jun 03 15:43:50.314850 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.314814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebba468-ba2c-4e7c-af20-fada0590ce02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.315033 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.314870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cebba468-ba2c-4e7c-af20-fada0590ce02-metrics-client-ca\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.315033 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.314969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7snd\" (UniqueName: \"kubernetes.io/projected/cebba468-ba2c-4e7c-af20-fada0590ce02-kube-api-access-z7snd\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.315033 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.315021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-federate-client-tls\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.315139 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.315082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebba468-ba2c-4e7c-af20-fada0590ce02-serving-certs-ca-bundle\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.315139 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.315134 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.315208 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.315158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-secret-telemeter-client\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.315208 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.315182 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-telemeter-client-tls\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.415861 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.415757 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cebba468-ba2c-4e7c-af20-fada0590ce02-metrics-client-ca\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.415861 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.415813 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7snd\" (UniqueName: \"kubernetes.io/projected/cebba468-ba2c-4e7c-af20-fada0590ce02-kube-api-access-z7snd\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.415861 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.415858 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-federate-client-tls\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.416222 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.415900 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebba468-ba2c-4e7c-af20-fada0590ce02-serving-certs-ca-bundle\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.416222 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.415977 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.416222 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.416008 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-secret-telemeter-client\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.416222 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.416036 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-telemeter-client-tls\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.416222 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.416188 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebba468-ba2c-4e7c-af20-fada0590ce02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.416730 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.416626 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cebba468-ba2c-4e7c-af20-fada0590ce02-metrics-client-ca\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.417105 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.417050 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebba468-ba2c-4e7c-af20-fada0590ce02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.417295 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.417272 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebba468-ba2c-4e7c-af20-fada0590ce02-serving-certs-ca-bundle\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.419385 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.419350 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-secret-telemeter-client\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.419488 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.419405 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-telemeter-client-tls\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.419488 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.419404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.419810 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.419791 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cebba468-ba2c-4e7c-af20-fada0590ce02-federate-client-tls\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.429857 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.429803 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7snd\" (UniqueName: \"kubernetes.io/projected/cebba468-ba2c-4e7c-af20-fada0590ce02-kube-api-access-z7snd\") pod \"telemeter-client-bf78b7d77-qqhc7\" (UID: \"cebba468-ba2c-4e7c-af20-fada0590ce02\") " pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.500962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.500907 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" Jun 03 15:43:50.843654 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.843619 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d69548986-jfnpt"] Jun 03 15:43:50.909378 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:50.909305 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bf78b7d77-qqhc7"] Jun 03 15:43:51.094096 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.093984 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerStarted","Data":"4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9"} Jun 03 15:43:51.251945 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.251904 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:43:51.257821 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.257789 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.265596 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.265125 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 15:43:51.265596 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.265377 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 15:43:51.267116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.266301 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 15:43:51.267116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.266422 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4vznl\"" Jun 03 15:43:51.267116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.266489 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6u7kbh7306vok\"" Jun 03 15:43:51.267116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.266509 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 15:43:51.267116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.266607 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 15:43:51.267116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.266655 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 15:43:51.267116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.266708 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 15:43:51.267116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.266789 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 15:43:51.267116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.267123 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 15:43:51.268044 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.267312 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 15:43:51.278622 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.278575 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 15:43:51.280283 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.280257 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:43:51.284293 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.284273 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 15:43:51.320980 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:51.320921 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcebba468_ba2c_4e7c_af20_fada0590ce02.slice/crio-3fc125368c30e5992bc6720627084b722a406abdebc8fa21250327e9a3872caa WatchSource:0}: Error finding container 3fc125368c30e5992bc6720627084b722a406abdebc8fa21250327e9a3872caa: Status 404 returned error can't find the container with id 3fc125368c30e5992bc6720627084b722a406abdebc8fa21250327e9a3872caa Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425658 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425825 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x9dt\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-kube-api-access-9x9dt\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.425970 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.426007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.426031 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.426058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.426100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.426470 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.426121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.427256 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.426146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.427256 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.426188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527176 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527143 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527304 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527196 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9x9dt\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-kube-api-access-9x9dt\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527304 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527228 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527304 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527259 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527460 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527297 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527460 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527354 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527460 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527413 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527460 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527449 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527692 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527488 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527692 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527515 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527692 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527546 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527692 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.527692 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.527591 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.528283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.528987 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.529612 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.529658 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.529695 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.529721 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.529748 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.529771 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.529841 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.530960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.530845 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.536167 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.535800 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.536298 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.536207 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.537527 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.536667 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.537527 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.536792 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.537527 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.537002 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.537736 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.537462 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.538407 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.537904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.548267 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.546800 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.551469 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.551394 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.551869 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.551812 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.552112 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.552089 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.553968 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.553896 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x9dt\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-kube-api-access-9x9dt\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.560801 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.558013 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.573673 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.573228 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:43:51.757563 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:51.757528 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:43:51.761166 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:51.761137 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ecfa18b_ca4d_4172_9319_cde6d81fbd91.slice/crio-425275dde75407b35be6a5f330240484b062fa1de5adcf2b5099f22d505a180b WatchSource:0}: Error finding container 425275dde75407b35be6a5f330240484b062fa1de5adcf2b5099f22d505a180b: Status 404 returned error can't find the container with id 425275dde75407b35be6a5f330240484b062fa1de5adcf2b5099f22d505a180b Jun 03 15:43:52.103396 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.103273 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerStarted","Data":"09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a"} Jun 03 15:43:52.103396 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.103319 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerStarted","Data":"6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be"} Jun 03 15:43:52.103396 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.103333 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerStarted","Data":"be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b"} Jun 03 15:43:52.103396 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.103346 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerStarted","Data":"8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168"} Jun 03 15:43:52.106798 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.106069 2566 generic.go:358] "Generic (PLEG): container finished" podID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerID="0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df" exitCode=0 Jun 03 15:43:52.106798 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.106183 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerDied","Data":"0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df"} Jun 03 15:43:52.106798 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.106208 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerStarted","Data":"425275dde75407b35be6a5f330240484b062fa1de5adcf2b5099f22d505a180b"} Jun 03 15:43:52.109251 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.109221 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" event={"ID":"85097c10-4cab-4346-9f20-84b24bec2118","Type":"ContainerStarted","Data":"e6aacc53e0386784d66b89dd0a0906b027330838c2ce91c2b7ed14c34770b769"} Jun 03 15:43:52.112711 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.112687 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" event={"ID":"cebba468-ba2c-4e7c-af20-fada0590ce02","Type":"ContainerStarted","Data":"3fc125368c30e5992bc6720627084b722a406abdebc8fa21250327e9a3872caa"} Jun 03 15:43:52.202646 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:52.202589 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" podStartSLOduration=1.6533122759999999 podStartE2EDuration="3.202569493s" podCreationTimestamp="2026-06-03 15:43:49 +0000 UTC" firstStartedPulling="2026-06-03 15:43:49.830043679 +0000 UTC m=+181.826342799" lastFinishedPulling="2026-06-03 15:43:51.379300898 +0000 UTC m=+183.375600016" observedRunningTime="2026-06-03 15:43:52.19971077 +0000 UTC m=+184.196009897" watchObservedRunningTime="2026-06-03 15:43:52.202569493 +0000 UTC m=+184.198868623" Jun 03 15:43:53.120189 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:53.120147 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerStarted","Data":"aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd"} Jun 03 15:43:53.156340 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:53.156286 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.970891336 podStartE2EDuration="8.156267113s" podCreationTimestamp="2026-06-03 15:43:45 +0000 UTC" firstStartedPulling="2026-06-03 15:43:47.178485036 +0000 UTC m=+179.174784142" lastFinishedPulling="2026-06-03 15:43:52.36386081 +0000 UTC m=+184.360159919" observedRunningTime="2026-06-03 15:43:53.153330606 +0000 UTC m=+185.149629732" watchObservedRunningTime="2026-06-03 15:43:53.156267113 +0000 UTC m=+185.152566223" Jun 03 15:43:54.132023 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:54.131978 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" event={"ID":"cebba468-ba2c-4e7c-af20-fada0590ce02","Type":"ContainerStarted","Data":"2ab09f9ffe813e9439b305393176e813318659933505524072da7088481d8fcd"} Jun 03 15:43:54.132023 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:54.132020 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" event={"ID":"cebba468-ba2c-4e7c-af20-fada0590ce02","Type":"ContainerStarted","Data":"2f77db0bde9285a2a55921b8426c90123d9546d3965032a0dcd4a4aad19deead"} Jun 03 15:43:54.132518 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:54.132035 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" event={"ID":"cebba468-ba2c-4e7c-af20-fada0590ce02","Type":"ContainerStarted","Data":"d6946bd09880fd633ab9dad95d171f337eef86b27c65d738387bd3e25bf3afff"} Jun 03 15:43:54.161121 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:54.161068 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bf78b7d77-qqhc7" podStartSLOduration=1.968033371 podStartE2EDuration="4.161051385s" podCreationTimestamp="2026-06-03 15:43:50 +0000 UTC" firstStartedPulling="2026-06-03 15:43:51.323141932 +0000 UTC m=+183.319441051" lastFinishedPulling="2026-06-03 15:43:53.516159957 +0000 UTC m=+185.512459065" observedRunningTime="2026-06-03 15:43:54.15889719 +0000 UTC m=+186.155196312" watchObservedRunningTime="2026-06-03 15:43:54.161051385 +0000 UTC m=+186.157350523" Jun 03 15:43:55.139498 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:55.139461 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerStarted","Data":"3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34"} Jun 03 15:43:55.139855 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:55.139515 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerStarted","Data":"2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64"} Jun 03 15:43:56.439157 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.439120 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f7d886dbc-fxqm5"] Jun 03 15:43:56.442382 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.442362 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.450838 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.450813 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 15:43:56.455810 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.455789 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7d886dbc-fxqm5"] Jun 03 15:43:56.484831 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.484802 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-serving-cert\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.485028 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.484882 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-service-ca\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.485028 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.484900 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-config\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.485028 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.484923 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hsds\" (UniqueName: \"kubernetes.io/projected/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-kube-api-access-4hsds\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.485028 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.485009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-oauth-serving-cert\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.485155 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.485086 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-trusted-ca-bundle\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.485155 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.485114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-oauth-config\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.585648 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.585612 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-trusted-ca-bundle\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.585814 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.585660 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-oauth-config\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.585814 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.585695 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-serving-cert\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.585992 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.585835 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-service-ca\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.585992 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.585865 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-config\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.585992 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.585902 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hsds\" (UniqueName: \"kubernetes.io/projected/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-kube-api-access-4hsds\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.586154 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.585989 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-oauth-serving-cert\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.586684 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.586644 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-service-ca\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.586786 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.586686 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-oauth-serving-cert\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.586786 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.586701 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-trusted-ca-bundle\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.586786 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.586644 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-config\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.588183 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.588162 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-oauth-config\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.588295 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.588276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-serving-cert\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.597276 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.597249 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hsds\" (UniqueName: \"kubernetes.io/projected/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-kube-api-access-4hsds\") pod \"console-6f7d886dbc-fxqm5\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.752467 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.752427 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:43:56.902192 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:56.902158 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7d886dbc-fxqm5"] Jun 03 15:43:57.325549 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:43:57.325515 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38cf5e19_ff8b_4173_bbc3_4ecee8e0c716.slice/crio-9030b4a88533630ae16a8e4e04a7c10537c287707321ecab4c00c67aa99e8cb1 WatchSource:0}: Error finding container 9030b4a88533630ae16a8e4e04a7c10537c287707321ecab4c00c67aa99e8cb1: Status 404 returned error can't find the container with id 9030b4a88533630ae16a8e4e04a7c10537c287707321ecab4c00c67aa99e8cb1 Jun 03 15:43:58.153196 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:58.153161 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerStarted","Data":"d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42"} Jun 03 15:43:58.153196 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:58.153202 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerStarted","Data":"298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7"} Jun 03 15:43:58.153691 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:58.153215 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerStarted","Data":"4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49"} Jun 03 15:43:58.153691 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:58.153228 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerStarted","Data":"daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f"} Jun 03 15:43:58.154617 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:58.154586 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7d886dbc-fxqm5" event={"ID":"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716","Type":"ContainerStarted","Data":"a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f"} Jun 03 15:43:58.154755 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:58.154625 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7d886dbc-fxqm5" event={"ID":"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716","Type":"ContainerStarted","Data":"9030b4a88533630ae16a8e4e04a7c10537c287707321ecab4c00c67aa99e8cb1"} Jun 03 15:43:58.193567 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:58.193510 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.924971301 podStartE2EDuration="7.193494256s" podCreationTimestamp="2026-06-03 15:43:51 +0000 UTC" firstStartedPulling="2026-06-03 15:43:52.108337019 +0000 UTC m=+184.104636132" lastFinishedPulling="2026-06-03 15:43:57.376859972 +0000 UTC m=+189.373159087" observedRunningTime="2026-06-03 15:43:58.190962748 +0000 UTC m=+190.187261874" watchObservedRunningTime="2026-06-03 15:43:58.193494256 +0000 UTC m=+190.189793382" Jun 03 15:43:58.215233 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:43:58.215187 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6f7d886dbc-fxqm5" podStartSLOduration=2.215171907 podStartE2EDuration="2.215171907s" podCreationTimestamp="2026-06-03 15:43:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:43:58.214130312 +0000 UTC m=+190.210429440" watchObservedRunningTime="2026-06-03 15:43:58.215171907 +0000 UTC m=+190.211471033" Jun 03 15:44:01.574670 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:01.574625 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:44:06.753457 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:06.753412 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:44:06.753923 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:06.753524 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:44:06.759099 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:06.759069 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:44:07.188491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:07.188410 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:44:09.687620 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:09.687576 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:44:09.687620 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:09.687622 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:44:11.198638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:11.198605 2566 generic.go:358] "Generic (PLEG): container finished" podID="6e0e2194-6372-40c3-b5ce-c36bbf309917" containerID="ffa04559f2f2047404fe091473dfd4d706624ad75e5be620feb589d9989a9b1e" exitCode=0 Jun 03 15:44:11.199084 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:11.198657 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" event={"ID":"6e0e2194-6372-40c3-b5ce-c36bbf309917","Type":"ContainerDied","Data":"ffa04559f2f2047404fe091473dfd4d706624ad75e5be620feb589d9989a9b1e"} Jun 03 15:44:11.199084 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:11.199024 2566 scope.go:117] "RemoveContainer" containerID="ffa04559f2f2047404fe091473dfd4d706624ad75e5be620feb589d9989a9b1e" Jun 03 15:44:12.203730 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:12.203697 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zfmn9" event={"ID":"6e0e2194-6372-40c3-b5ce-c36bbf309917","Type":"ContainerStarted","Data":"5addb52b214fe5770a9a4d222cae00dcfd9fd5ca1ce71bdeb2f29b7ac2fcf494"} Jun 03 15:44:17.142232 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.142168 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-d69548986-jfnpt" podUID="9fb44424-1196-4c28-891c-da0878bbe451" containerName="console" containerID="cri-o://33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd" gracePeriod=15 Jun 03 15:44:17.402052 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.401972 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d69548986-jfnpt_9fb44424-1196-4c28-891c-da0878bbe451/console/0.log" Jun 03 15:44:17.402052 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.402033 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:44:17.494970 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.494916 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-service-ca\") pod \"9fb44424-1196-4c28-891c-da0878bbe451\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " Jun 03 15:44:17.495153 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.495040 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-oauth-config\") pod \"9fb44424-1196-4c28-891c-da0878bbe451\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " Jun 03 15:44:17.495153 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.495079 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-serving-cert\") pod \"9fb44424-1196-4c28-891c-da0878bbe451\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " Jun 03 15:44:17.495153 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.495102 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-console-config\") pod \"9fb44424-1196-4c28-891c-da0878bbe451\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " Jun 03 15:44:17.495153 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.495125 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-oauth-serving-cert\") pod \"9fb44424-1196-4c28-891c-da0878bbe451\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " Jun 03 15:44:17.495153 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.495149 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ghkh\" (UniqueName: \"kubernetes.io/projected/9fb44424-1196-4c28-891c-da0878bbe451-kube-api-access-8ghkh\") pod \"9fb44424-1196-4c28-891c-da0878bbe451\" (UID: \"9fb44424-1196-4c28-891c-da0878bbe451\") " Jun 03 15:44:17.495550 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.495515 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-service-ca" (OuterVolumeSpecName: "service-ca") pod "9fb44424-1196-4c28-891c-da0878bbe451" (UID: "9fb44424-1196-4c28-891c-da0878bbe451"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:17.495674 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.495629 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9fb44424-1196-4c28-891c-da0878bbe451" (UID: "9fb44424-1196-4c28-891c-da0878bbe451"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:17.495745 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.495682 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-console-config" (OuterVolumeSpecName: "console-config") pod "9fb44424-1196-4c28-891c-da0878bbe451" (UID: "9fb44424-1196-4c28-891c-da0878bbe451"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:17.497517 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.497488 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9fb44424-1196-4c28-891c-da0878bbe451" (UID: "9fb44424-1196-4c28-891c-da0878bbe451"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:44:17.497615 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.497513 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9fb44424-1196-4c28-891c-da0878bbe451" (UID: "9fb44424-1196-4c28-891c-da0878bbe451"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:44:17.497615 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.497486 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb44424-1196-4c28-891c-da0878bbe451-kube-api-access-8ghkh" (OuterVolumeSpecName: "kube-api-access-8ghkh") pod "9fb44424-1196-4c28-891c-da0878bbe451" (UID: "9fb44424-1196-4c28-891c-da0878bbe451"). InnerVolumeSpecName "kube-api-access-8ghkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:44:17.596020 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.595977 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-oauth-config\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:44:17.596020 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.596013 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb44424-1196-4c28-891c-da0878bbe451-console-serving-cert\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:44:17.596020 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.596023 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-console-config\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:44:17.596256 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.596033 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-oauth-serving-cert\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:44:17.596256 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.596044 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ghkh\" (UniqueName: \"kubernetes.io/projected/9fb44424-1196-4c28-891c-da0878bbe451-kube-api-access-8ghkh\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:44:17.596256 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:17.596053 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb44424-1196-4c28-891c-da0878bbe451-service-ca\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:44:18.226536 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.226507 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d69548986-jfnpt_9fb44424-1196-4c28-891c-da0878bbe451/console/0.log" Jun 03 15:44:18.226981 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.226547 2566 generic.go:358] "Generic (PLEG): container finished" podID="9fb44424-1196-4c28-891c-da0878bbe451" containerID="33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd" exitCode=2 Jun 03 15:44:18.226981 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.226597 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d69548986-jfnpt" event={"ID":"9fb44424-1196-4c28-891c-da0878bbe451","Type":"ContainerDied","Data":"33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd"} Jun 03 15:44:18.226981 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.226620 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d69548986-jfnpt" event={"ID":"9fb44424-1196-4c28-891c-da0878bbe451","Type":"ContainerDied","Data":"7a64118f2678355a282e9c37c7b11144d02e3e803fe6577e50d316cfbb32c1f8"} Jun 03 15:44:18.226981 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.226645 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d69548986-jfnpt" Jun 03 15:44:18.226981 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.226645 2566 scope.go:117] "RemoveContainer" containerID="33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd" Jun 03 15:44:18.237146 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.237127 2566 scope.go:117] "RemoveContainer" containerID="33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd" Jun 03 15:44:18.237441 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:44:18.237411 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd\": container with ID starting with 33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd not found: ID does not exist" containerID="33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd" Jun 03 15:44:18.237546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.237450 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd"} err="failed to get container status \"33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd\": rpc error: code = NotFound desc = could not find container \"33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd\": container with ID starting with 33cd2a0ad736d5d174e483214a2fcc1edc79cb1ef96b94918309b4891170a0cd not found: ID does not exist" Jun 03 15:44:18.248868 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.248839 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d69548986-jfnpt"] Jun 03 15:44:18.253347 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.253321 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d69548986-jfnpt"] Jun 03 15:44:18.543464 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:18.543371 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb44424-1196-4c28-891c-da0878bbe451" path="/var/lib/kubelet/pods/9fb44424-1196-4c28-891c-da0878bbe451/volumes" Jun 03 15:44:29.693190 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:29.693157 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:44:29.697372 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:29.697342 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8ccd54697-p5h52" Jun 03 15:44:39.293480 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:39.293451 2566 generic.go:358] "Generic (PLEG): container finished" podID="605527c8-eded-4627-9588-a523bbac42dd" containerID="b9b69508ddfa942198626fa925b508e16d5fa9e378b481d575e2366fcabbdc28" exitCode=0 Jun 03 15:44:39.293865 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:39.293525 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-54mdl" event={"ID":"605527c8-eded-4627-9588-a523bbac42dd","Type":"ContainerDied","Data":"b9b69508ddfa942198626fa925b508e16d5fa9e378b481d575e2366fcabbdc28"} Jun 03 15:44:39.293968 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:39.293880 2566 scope.go:117] "RemoveContainer" containerID="b9b69508ddfa942198626fa925b508e16d5fa9e378b481d575e2366fcabbdc28" Jun 03 15:44:40.298605 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:40.298576 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-54mdl" event={"ID":"605527c8-eded-4627-9588-a523bbac42dd","Type":"ContainerStarted","Data":"5ed79ff8b3e431541bbd2af8e5f8ca06a550a7f5887553cfcf223edc3a1d709a"} Jun 03 15:44:51.574004 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:51.573970 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:44:51.596284 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:51.596254 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:44:52.356235 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:44:52.356200 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:00.292940 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:00.292891 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:45:00.295255 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:00.295227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e5465-29a7-4ab3-b71f-305d11a1733e-metrics-certs\") pod \"network-metrics-daemon-r8tzl\" (UID: \"ed7e5465-29a7-4ab3-b71f-305d11a1733e\") " pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:45:00.447443 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:00.447409 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q8ntl\"" Jun 03 15:45:00.454709 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:00.454678 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tzl" Jun 03 15:45:00.595041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:00.594955 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8tzl"] Jun 03 15:45:00.597890 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:45:00.597858 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7e5465_29a7_4ab3_b71f_305d11a1733e.slice/crio-8f9d5ac74686d0f4384cf5b5272566ee772f985f85219089848d45f2638caf5b WatchSource:0}: Error finding container 8f9d5ac74686d0f4384cf5b5272566ee772f985f85219089848d45f2638caf5b: Status 404 returned error can't find the container with id 8f9d5ac74686d0f4384cf5b5272566ee772f985f85219089848d45f2638caf5b Jun 03 15:45:01.372947 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:01.372881 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8tzl" event={"ID":"ed7e5465-29a7-4ab3-b71f-305d11a1733e","Type":"ContainerStarted","Data":"8f9d5ac74686d0f4384cf5b5272566ee772f985f85219089848d45f2638caf5b"} Jun 03 15:45:02.377722 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:02.377691 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8tzl" event={"ID":"ed7e5465-29a7-4ab3-b71f-305d11a1733e","Type":"ContainerStarted","Data":"40aedc222f2685c63590155362a7428f4f5aa7e36665ee4ee2385051db354f6d"} Jun 03 15:45:02.377722 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:02.377725 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8tzl" event={"ID":"ed7e5465-29a7-4ab3-b71f-305d11a1733e","Type":"ContainerStarted","Data":"be2253c9390dead6c6fcdcb44d489ae9b8ed9d63167ae3ff12e7a4d3da5ea141"} Jun 03 15:45:02.406608 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:02.406554 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r8tzl" podStartSLOduration=253.527630564 podStartE2EDuration="4m14.406538932s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:45:00.599866106 +0000 UTC m=+252.596165211" lastFinishedPulling="2026-06-03 15:45:01.478774473 +0000 UTC m=+253.475073579" observedRunningTime="2026-06-03 15:45:02.406300705 +0000 UTC m=+254.402599833" watchObservedRunningTime="2026-06-03 15:45:02.406538932 +0000 UTC m=+254.402838059" Jun 03 15:45:05.440865 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:05.440819 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:45:05.441380 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:05.441269 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="alertmanager" containerID="cri-o://4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9" gracePeriod=120 Jun 03 15:45:05.441380 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:05.441313 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy-metric" containerID="cri-o://09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a" gracePeriod=120 Jun 03 15:45:05.441498 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:05.441343 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy-web" containerID="cri-o://be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b" gracePeriod=120 Jun 03 15:45:05.441498 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:05.441367 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="prom-label-proxy" containerID="cri-o://aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd" gracePeriod=120 Jun 03 15:45:05.441498 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:05.441423 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="config-reloader" containerID="cri-o://8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168" gracePeriod=120 Jun 03 15:45:05.441498 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:05.441376 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy" containerID="cri-o://6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be" gracePeriod=120 Jun 03 15:45:06.394481 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394399 2566 generic.go:358] "Generic (PLEG): container finished" podID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerID="aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd" exitCode=0 Jun 03 15:45:06.394481 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394423 2566 generic.go:358] "Generic (PLEG): container finished" podID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerID="09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a" exitCode=0 Jun 03 15:45:06.394481 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394430 2566 generic.go:358] "Generic (PLEG): container finished" podID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerID="6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be" exitCode=0 Jun 03 15:45:06.394481 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394436 2566 generic.go:358] "Generic (PLEG): container finished" podID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerID="8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168" exitCode=0 Jun 03 15:45:06.394481 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394441 2566 generic.go:358] "Generic (PLEG): container finished" podID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerID="4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9" exitCode=0 Jun 03 15:45:06.394765 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394479 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerDied","Data":"aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd"} Jun 03 15:45:06.394765 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394522 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerDied","Data":"09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a"} Jun 03 15:45:06.394765 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394533 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerDied","Data":"6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be"} Jun 03 15:45:06.394765 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394543 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerDied","Data":"8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168"} Jun 03 15:45:06.394765 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.394551 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerDied","Data":"4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9"} Jun 03 15:45:06.700787 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.700764 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:06.745122 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745090 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745326 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745133 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-volume\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745326 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745169 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745326 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745194 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-main-tls\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745326 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745223 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-main-db\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745326 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745248 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-tls-assets\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745326 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745310 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-web-config\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745340 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-out\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745369 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-web\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745399 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-trusted-ca-bundle\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745442 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-metrics-client-ca\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745491 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8czs6\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-kube-api-access-8czs6\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.745638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.745516 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-cluster-tls-config\") pod \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\" (UID: \"11d6b901-64fa-4d5c-85d5-d63a5db53acc\") " Jun 03 15:45:06.747412 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.747163 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:45:06.748499 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.748431 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:06.748708 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.748301 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:06.749349 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.749300 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-volume" (OuterVolumeSpecName: "config-volume") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:06.752716 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.752680 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:06.753160 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.753135 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:06.753788 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.753489 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-kube-api-access-8czs6" (OuterVolumeSpecName: "kube-api-access-8czs6") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "kube-api-access-8czs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:45:06.753788 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.753742 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-out" (OuterVolumeSpecName: "config-out") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:45:06.755306 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.755280 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:06.756027 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.755657 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:45:06.756485 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.756179 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:06.756727 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.756701 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:06.768719 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.768677 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-web-config" (OuterVolumeSpecName: "web-config") pod "11d6b901-64fa-4d5c-85d5-d63a5db53acc" (UID: "11d6b901-64fa-4d5c-85d5-d63a5db53acc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:06.846264 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846222 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8czs6\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-kube-api-access-8czs6\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846264 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846258 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-cluster-tls-config\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846264 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846270 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846280 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-volume\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846290 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846299 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-main-tls\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846310 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-main-db\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846318 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11d6b901-64fa-4d5c-85d5-d63a5db53acc-tls-assets\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846331 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-web-config\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846339 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11d6b901-64fa-4d5c-85d5-d63a5db53acc-config-out\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846347 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11d6b901-64fa-4d5c-85d5-d63a5db53acc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846356 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:06.846474 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:06.846366 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d6b901-64fa-4d5c-85d5-d63a5db53acc-metrics-client-ca\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:07.400420 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.400385 2566 generic.go:358] "Generic (PLEG): container finished" podID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerID="be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b" exitCode=0 Jun 03 15:45:07.400630 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.400469 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerDied","Data":"be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b"} Jun 03 15:45:07.400630 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.400506 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.400630 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.400520 2566 scope.go:117] "RemoveContainer" containerID="aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd" Jun 03 15:45:07.400630 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.400509 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11d6b901-64fa-4d5c-85d5-d63a5db53acc","Type":"ContainerDied","Data":"8a6ae6a6494d287634183286b90702370d4114f2b52af0e653be270a221ced9a"} Jun 03 15:45:07.408511 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.408490 2566 scope.go:117] "RemoveContainer" containerID="09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a" Jun 03 15:45:07.415891 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.415872 2566 scope.go:117] "RemoveContainer" containerID="6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be" Jun 03 15:45:07.423099 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.423078 2566 scope.go:117] "RemoveContainer" containerID="be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b" Jun 03 15:45:07.430736 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.428821 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:45:07.433173 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.433028 2566 scope.go:117] "RemoveContainer" containerID="8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168" Jun 03 15:45:07.437462 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.437436 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:45:07.445392 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.445365 2566 scope.go:117] "RemoveContainer" containerID="4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9" Jun 03 15:45:07.453650 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.453628 2566 scope.go:117] "RemoveContainer" containerID="4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c" Jun 03 15:45:07.461155 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.461127 2566 scope.go:117] "RemoveContainer" containerID="aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd" Jun 03 15:45:07.461468 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:07.461445 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd\": container with ID starting with aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd not found: ID does not exist" containerID="aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd" Jun 03 15:45:07.461524 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.461482 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd"} err="failed to get container status \"aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd\": rpc error: code = NotFound desc = could not find container \"aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd\": container with ID starting with aee8694ddb1fbb6a68b981dd213c6d82df040eb557edcdd2eab2d360bec583fd not found: ID does not exist" Jun 03 15:45:07.461524 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.461506 2566 scope.go:117] "RemoveContainer" containerID="09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a" Jun 03 15:45:07.461755 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:07.461733 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a\": container with ID starting with 09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a not found: ID does not exist" containerID="09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a" Jun 03 15:45:07.461795 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.461762 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a"} err="failed to get container status \"09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a\": rpc error: code = NotFound desc = could not find container \"09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a\": container with ID starting with 09fe00c7eabae3d59afa53c4f96b2c0b9e7b112c2decc7b2e39b53227f7df45a not found: ID does not exist" Jun 03 15:45:07.461795 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.461785 2566 scope.go:117] "RemoveContainer" containerID="6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be" Jun 03 15:45:07.462022 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:07.462005 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be\": container with ID starting with 6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be not found: ID does not exist" containerID="6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be" Jun 03 15:45:07.462070 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.462026 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be"} err="failed to get container status \"6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be\": rpc error: code = NotFound desc = could not find container \"6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be\": container with ID starting with 6fc81d113554925f0d060e731ca4afcac330c233e15fc70eb509ed0e48d550be not found: ID does not exist" Jun 03 15:45:07.462070 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.462040 2566 scope.go:117] "RemoveContainer" containerID="be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b" Jun 03 15:45:07.462239 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:07.462221 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b\": container with ID starting with be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b not found: ID does not exist" containerID="be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b" Jun 03 15:45:07.462281 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.462243 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b"} err="failed to get container status \"be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b\": rpc error: code = NotFound desc = could not find container \"be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b\": container with ID starting with be9d1bb18d3cab3d7a1931e57bf558fa7e3fc0136dd4b01a200a2343b347163b not found: ID does not exist" Jun 03 15:45:07.462281 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.462257 2566 scope.go:117] "RemoveContainer" containerID="8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168" Jun 03 15:45:07.462491 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:07.462475 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168\": container with ID starting with 8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168 not found: ID does not exist" containerID="8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168" Jun 03 15:45:07.462537 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.462504 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168"} err="failed to get container status \"8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168\": rpc error: code = NotFound desc = could not find container \"8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168\": container with ID starting with 8ea99365db43ffba19335ca698b10dc868019c96e04396f9280a0447c29f5168 not found: ID does not exist" Jun 03 15:45:07.462537 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.462517 2566 scope.go:117] "RemoveContainer" containerID="4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9" Jun 03 15:45:07.462764 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:07.462747 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9\": container with ID starting with 4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9 not found: ID does not exist" containerID="4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9" Jun 03 15:45:07.462805 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.462768 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9"} err="failed to get container status \"4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9\": rpc error: code = NotFound desc = could not find container \"4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9\": container with ID starting with 4058af239781294749819a54397e975e7d1762b44ede5cebfa3da8d2bb2a17a9 not found: ID does not exist" Jun 03 15:45:07.462805 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.462791 2566 scope.go:117] "RemoveContainer" containerID="4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c" Jun 03 15:45:07.463168 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:07.463151 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c\": container with ID starting with 4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c not found: ID does not exist" containerID="4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c" Jun 03 15:45:07.463225 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:07.463170 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c"} err="failed to get container status \"4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c\": rpc error: code = NotFound desc = could not find container \"4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c\": container with ID starting with 4bf7cf60d129529bdae67582cb47292e77c29bc34361b45f682ebd1f18cd740c not found: ID does not exist" Jun 03 15:45:08.543052 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:08.543020 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" path="/var/lib/kubelet/pods/11d6b901-64fa-4d5c-85d5-d63a5db53acc/volumes" Jun 03 15:45:09.728987 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:09.728939 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:45:09.729530 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:09.729397 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="prometheus" containerID="cri-o://2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64" gracePeriod=600 Jun 03 15:45:09.729530 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:09.729426 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy" containerID="cri-o://298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7" gracePeriod=600 Jun 03 15:45:09.729530 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:09.729469 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy-web" containerID="cri-o://4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49" gracePeriod=600 Jun 03 15:45:09.729530 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:09.729469 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42" gracePeriod=600 Jun 03 15:45:09.729744 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:09.729541 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="config-reloader" containerID="cri-o://3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34" gracePeriod=600 Jun 03 15:45:09.729744 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:09.729478 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="thanos-sidecar" containerID="cri-o://daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f" gracePeriod=600 Jun 03 15:45:10.414171 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414137 2566 generic.go:358] "Generic (PLEG): container finished" podID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerID="d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42" exitCode=0 Jun 03 15:45:10.414171 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414162 2566 generic.go:358] "Generic (PLEG): container finished" podID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerID="298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7" exitCode=0 Jun 03 15:45:10.414171 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414169 2566 generic.go:358] "Generic (PLEG): container finished" podID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerID="daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f" exitCode=0 Jun 03 15:45:10.414491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414186 2566 generic.go:358] "Generic (PLEG): container finished" podID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerID="3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34" exitCode=0 Jun 03 15:45:10.414491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414195 2566 generic.go:358] "Generic (PLEG): container finished" podID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerID="2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64" exitCode=0 Jun 03 15:45:10.414491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414209 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerDied","Data":"d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42"} Jun 03 15:45:10.414491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414246 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerDied","Data":"298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7"} Jun 03 15:45:10.414491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414258 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerDied","Data":"daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f"} Jun 03 15:45:10.414491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414267 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerDied","Data":"3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34"} Jun 03 15:45:10.414491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.414276 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerDied","Data":"2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64"} Jun 03 15:45:10.985921 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:10.985900 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.078551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078514 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-kube-rbac-proxy\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.078735 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078564 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-kubelet-serving-ca-bundle\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.078735 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078589 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-tls-assets\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.078735 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078604 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x9dt\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-kube-api-access-9x9dt\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.078735 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078625 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.078735 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078650 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-metrics-client-certs\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.078735 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078718 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-rulefiles-0\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078742 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-serving-certs-ca-bundle\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078769 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-db\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078792 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-thanos-prometheus-http-client-file\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078825 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-trusted-ca-bundle\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078856 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-web-config\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078880 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078916 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-grpc-tls\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.078958 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-metrics-client-ca\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.079032 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079082 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.079063 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-tls\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.079098 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config-out\") pod \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\" (UID: \"6ecfa18b-ca4d-4172-9319-cde6d81fbd91\") " Jun 03 15:45:11.079546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.079225 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:11.079546 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.079442 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.081134 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.081045 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:45:11.081385 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.081316 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:11.082860 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.082645 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:11.082860 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.082830 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:11.082860 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.082833 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:11.083112 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.082948 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:11.083112 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.083089 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config" (OuterVolumeSpecName: "config") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:11.083507 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.083470 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-kube-api-access-9x9dt" (OuterVolumeSpecName: "kube-api-access-9x9dt") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "kube-api-access-9x9dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:45:11.083600 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.083549 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config-out" (OuterVolumeSpecName: "config-out") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:45:11.083669 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.083623 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:45:11.084309 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.084285 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:11.084649 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.084624 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:11.085496 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.085460 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:11.086362 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.086305 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:11.086655 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.086634 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:11.087051 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.087027 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:11.096807 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.096770 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-web-config" (OuterVolumeSpecName: "web-config") pod "6ecfa18b-ca4d-4172-9319-cde6d81fbd91" (UID: "6ecfa18b-ca4d-4172-9319-cde6d81fbd91"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:11.179988 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.179906 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.179988 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.179986 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.179988 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.179999 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-k8s-db\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.179988 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180008 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180018 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180027 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-web-config\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180037 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180046 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-grpc-tls\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180055 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-configmap-metrics-client-ca\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180063 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180072 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180081 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config-out\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180090 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-kube-rbac-proxy\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180100 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-tls-assets\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180109 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x9dt\" (UniqueName: \"kubernetes.io/projected/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-kube-api-access-9x9dt\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180118 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-config\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.180252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.180126 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ecfa18b-ca4d-4172-9319-cde6d81fbd91-secret-metrics-client-certs\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:11.420662 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.420568 2566 generic.go:358] "Generic (PLEG): container finished" podID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerID="4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49" exitCode=0 Jun 03 15:45:11.420662 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.420627 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerDied","Data":"4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49"} Jun 03 15:45:11.420662 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.420656 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ecfa18b-ca4d-4172-9319-cde6d81fbd91","Type":"ContainerDied","Data":"425275dde75407b35be6a5f330240484b062fa1de5adcf2b5099f22d505a180b"} Jun 03 15:45:11.420960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.420673 2566 scope.go:117] "RemoveContainer" containerID="d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42" Jun 03 15:45:11.420960 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.420728 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.428505 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.428487 2566 scope.go:117] "RemoveContainer" containerID="298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7" Jun 03 15:45:11.435733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.435715 2566 scope.go:117] "RemoveContainer" containerID="4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49" Jun 03 15:45:11.442607 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.442586 2566 scope.go:117] "RemoveContainer" containerID="daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f" Jun 03 15:45:11.448074 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.448047 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:45:11.452217 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.452191 2566 scope.go:117] "RemoveContainer" containerID="3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34" Jun 03 15:45:11.452399 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.452380 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:45:11.459768 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.459742 2566 scope.go:117] "RemoveContainer" containerID="2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64" Jun 03 15:45:11.469884 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.469856 2566 scope.go:117] "RemoveContainer" containerID="0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df" Jun 03 15:45:11.477001 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.476977 2566 scope.go:117] "RemoveContainer" containerID="d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42" Jun 03 15:45:11.477244 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:11.477229 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42\": container with ID starting with d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42 not found: ID does not exist" containerID="d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42" Jun 03 15:45:11.477290 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.477253 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42"} err="failed to get container status \"d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42\": rpc error: code = NotFound desc = could not find container \"d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42\": container with ID starting with d3a9fe53ce3629feebd52793b93b8368fd6952e94282a4825fb3425b7b0ffd42 not found: ID does not exist" Jun 03 15:45:11.477290 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.477271 2566 scope.go:117] "RemoveContainer" containerID="298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7" Jun 03 15:45:11.477467 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:11.477454 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7\": container with ID starting with 298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7 not found: ID does not exist" containerID="298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7" Jun 03 15:45:11.477502 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.477470 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7"} err="failed to get container status \"298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7\": rpc error: code = NotFound desc = could not find container \"298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7\": container with ID starting with 298bfee03c6d04ad2989f804d7bedcea46abf68a8d3b85b151d13a49f3ed75f7 not found: ID does not exist" Jun 03 15:45:11.477502 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.477480 2566 scope.go:117] "RemoveContainer" containerID="4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49" Jun 03 15:45:11.477705 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:11.477683 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49\": container with ID starting with 4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49 not found: ID does not exist" containerID="4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49" Jun 03 15:45:11.477806 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.477716 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49"} err="failed to get container status \"4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49\": rpc error: code = NotFound desc = could not find container \"4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49\": container with ID starting with 4d4627cc1504a2e0b37885540c5f42b851c3920cc9d8b50d78c4b149ecc0cd49 not found: ID does not exist" Jun 03 15:45:11.477806 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.477740 2566 scope.go:117] "RemoveContainer" containerID="daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f" Jun 03 15:45:11.478114 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:11.478085 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f\": container with ID starting with daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f not found: ID does not exist" containerID="daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f" Jun 03 15:45:11.478207 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.478107 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f"} err="failed to get container status \"daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f\": rpc error: code = NotFound desc = could not find container \"daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f\": container with ID starting with daac6ec414318782658f112879e554398438d88ab7b9f06193abc2edc279ff3f not found: ID does not exist" Jun 03 15:45:11.478207 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.478129 2566 scope.go:117] "RemoveContainer" containerID="3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34" Jun 03 15:45:11.478450 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:11.478423 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34\": container with ID starting with 3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34 not found: ID does not exist" containerID="3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34" Jun 03 15:45:11.478551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.478455 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34"} err="failed to get container status \"3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34\": rpc error: code = NotFound desc = could not find container \"3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34\": container with ID starting with 3499bf10a6ed022b4261b5f6dd57eea01f68b8fb676eaf5066c2a930d2078c34 not found: ID does not exist" Jun 03 15:45:11.478551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.478474 2566 scope.go:117] "RemoveContainer" containerID="2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64" Jun 03 15:45:11.479056 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:11.478999 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64\": container with ID starting with 2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64 not found: ID does not exist" containerID="2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64" Jun 03 15:45:11.479160 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.479063 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64"} err="failed to get container status \"2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64\": rpc error: code = NotFound desc = could not find container \"2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64\": container with ID starting with 2c2e17dd5765fca5bea70915da78bb237802b5d10dcfee77617a99cf37b29c64 not found: ID does not exist" Jun 03 15:45:11.479160 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.479085 2566 scope.go:117] "RemoveContainer" containerID="0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df" Jun 03 15:45:11.479340 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:11.479323 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df\": container with ID starting with 0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df not found: ID does not exist" containerID="0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df" Jun 03 15:45:11.479390 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.479347 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df"} err="failed to get container status \"0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df\": rpc error: code = NotFound desc = could not find container \"0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df\": container with ID starting with 0d72c5d3efb445af4f3da58a5afd7cd51c52048fc3b7814904f35446170717df not found: ID does not exist" Jun 03 15:45:11.480598 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480580 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:45:11.480904 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480892 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="init-config-reloader" Jun 03 15:45:11.480962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480905 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="init-config-reloader" Jun 03 15:45:11.480962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480914 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="alertmanager" Jun 03 15:45:11.480962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480919 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="alertmanager" Jun 03 15:45:11.480962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480939 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="init-config-reloader" Jun 03 15:45:11.480962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480945 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="init-config-reloader" Jun 03 15:45:11.480962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480954 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy-metric" Jun 03 15:45:11.480962 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480959 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy-metric" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480966 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy-web" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480971 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy-web" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480979 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy-thanos" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480985 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy-thanos" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480992 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb44424-1196-4c28-891c-da0878bbe451" containerName="console" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.480997 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb44424-1196-4c28-891c-da0878bbe451" containerName="console" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481003 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481008 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481014 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy-web" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481020 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy-web" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481027 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481032 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481040 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="prom-label-proxy" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481045 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="prom-label-proxy" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481051 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="prometheus" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481056 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="prometheus" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481061 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="config-reloader" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481066 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="config-reloader" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481073 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="thanos-sidecar" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481078 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="thanos-sidecar" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481086 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="config-reloader" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481091 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="config-reloader" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481137 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="alertmanager" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481145 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="prom-label-proxy" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481152 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="thanos-sidecar" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481157 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481163 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="prometheus" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481170 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="config-reloader" Jun 03 15:45:11.481165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481177 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy-thanos" Jun 03 15:45:11.482372 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481183 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy-metric" Jun 03 15:45:11.482372 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481189 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" containerName="kube-rbac-proxy-web" Jun 03 15:45:11.482372 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481196 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="config-reloader" Jun 03 15:45:11.482372 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481202 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy-web" Jun 03 15:45:11.482372 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481208 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9fb44424-1196-4c28-891c-da0878bbe451" containerName="console" Jun 03 15:45:11.482372 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.481214 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="11d6b901-64fa-4d5c-85d5-d63a5db53acc" containerName="kube-rbac-proxy" Jun 03 15:45:11.485116 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.485089 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.488089 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.488066 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 15:45:11.488252 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.488235 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 15:45:11.489039 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489024 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4vznl\"" Jun 03 15:45:11.489101 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489067 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 15:45:11.489185 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489169 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 15:45:11.489233 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489220 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 15:45:11.489453 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489433 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 15:45:11.489754 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489611 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 15:45:11.489754 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489625 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 15:45:11.489920 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489837 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 15:45:11.489920 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489901 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6u7kbh7306vok\"" Jun 03 15:45:11.489920 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.489907 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 15:45:11.493539 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.493518 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 15:45:11.496964 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.496940 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 15:45:11.498748 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.498726 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:45:11.583253 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583409 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583262 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583409 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583409 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583343 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583409 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjrw5\" (UniqueName: \"kubernetes.io/projected/799a2133-99bd-4bc7-a172-2a9251261c03-kube-api-access-mjrw5\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583567 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583567 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583567 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583485 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583567 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583536 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-web-config\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583684 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583684 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583684 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583635 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/799a2133-99bd-4bc7-a172-2a9251261c03-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583684 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/799a2133-99bd-4bc7-a172-2a9251261c03-config-out\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583684 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583837 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583837 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583781 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/799a2133-99bd-4bc7-a172-2a9251261c03-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583837 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583811 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-config\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.583975 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.583833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.684830 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.684741 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/799a2133-99bd-4bc7-a172-2a9251261c03-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.684830 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.684786 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-config\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.684830 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.684806 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.684838 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.684859 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.684874 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.684895 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.684916 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjrw5\" (UniqueName: \"kubernetes.io/projected/799a2133-99bd-4bc7-a172-2a9251261c03-kube-api-access-mjrw5\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.684981 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685010 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685037 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685073 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-web-config\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685104 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685601 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685131 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685601 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685168 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/799a2133-99bd-4bc7-a172-2a9251261c03-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685601 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685193 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/799a2133-99bd-4bc7-a172-2a9251261c03-config-out\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685601 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685218 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685601 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685260 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/799a2133-99bd-4bc7-a172-2a9251261c03-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685866 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685716 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.685866 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685733 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.688547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.688231 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.688547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.688249 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-web-config\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.688547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.688322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.688547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.688348 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.688547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.685266 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.688547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.688371 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-config\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.688547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.688388 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/799a2133-99bd-4bc7-a172-2a9251261c03-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.688547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.688489 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.689099 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.688947 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.689274 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.689254 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.689619 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.689600 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/799a2133-99bd-4bc7-a172-2a9251261c03-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.690467 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.690452 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/799a2133-99bd-4bc7-a172-2a9251261c03-config-out\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.690823 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.690796 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.690916 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.690826 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.690916 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.690898 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/799a2133-99bd-4bc7-a172-2a9251261c03-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.694996 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.694974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjrw5\" (UniqueName: \"kubernetes.io/projected/799a2133-99bd-4bc7-a172-2a9251261c03-kube-api-access-mjrw5\") pod \"prometheus-k8s-0\" (UID: \"799a2133-99bd-4bc7-a172-2a9251261c03\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.795541 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.795496 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:11.943183 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:11.943159 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:45:11.945790 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:45:11.945760 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799a2133_99bd_4bc7_a172_2a9251261c03.slice/crio-368648635ff08a816e998c4d282d37a42a21fead83c7edf80c399d400c8941aa WatchSource:0}: Error finding container 368648635ff08a816e998c4d282d37a42a21fead83c7edf80c399d400c8941aa: Status 404 returned error can't find the container with id 368648635ff08a816e998c4d282d37a42a21fead83c7edf80c399d400c8941aa Jun 03 15:45:12.424820 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:12.424779 2566 generic.go:358] "Generic (PLEG): container finished" podID="799a2133-99bd-4bc7-a172-2a9251261c03" containerID="fa7723110f46cacdac7ceff496e8fbc7fc489ee366463e572fb27ae86790dcf2" exitCode=0 Jun 03 15:45:12.425260 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:12.424863 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"799a2133-99bd-4bc7-a172-2a9251261c03","Type":"ContainerDied","Data":"fa7723110f46cacdac7ceff496e8fbc7fc489ee366463e572fb27ae86790dcf2"} Jun 03 15:45:12.425260 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:12.424900 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"799a2133-99bd-4bc7-a172-2a9251261c03","Type":"ContainerStarted","Data":"368648635ff08a816e998c4d282d37a42a21fead83c7edf80c399d400c8941aa"} Jun 03 15:45:12.547369 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:12.547326 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ecfa18b-ca4d-4172-9319-cde6d81fbd91" path="/var/lib/kubelet/pods/6ecfa18b-ca4d-4172-9319-cde6d81fbd91/volumes" Jun 03 15:45:13.431396 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:13.431354 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"799a2133-99bd-4bc7-a172-2a9251261c03","Type":"ContainerStarted","Data":"7970f508e2238646e33337d9c4b90ef12cb91527eb3e1bb0ba81042e20822499"} Jun 03 15:45:13.431396 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:13.431395 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"799a2133-99bd-4bc7-a172-2a9251261c03","Type":"ContainerStarted","Data":"84da8187ebd6d09bd30f195238cb84fcc789a5bad9ccdeda40d39902a664f008"} Jun 03 15:45:13.431396 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:13.431405 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"799a2133-99bd-4bc7-a172-2a9251261c03","Type":"ContainerStarted","Data":"bdda126b12a413102e9969e2d45751ec3765609b8c52c994dddfcf30f6649587"} Jun 03 15:45:13.431826 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:13.431414 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"799a2133-99bd-4bc7-a172-2a9251261c03","Type":"ContainerStarted","Data":"21319e9ee8241db5187b103331b02ab29ed95ddd31c0d2fc68e276aa40747466"} Jun 03 15:45:13.431826 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:13.431423 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"799a2133-99bd-4bc7-a172-2a9251261c03","Type":"ContainerStarted","Data":"21eaac3414510e6f901b62946af0e9dd4b0ae09a37dabbb2f9297d30a540ecbc"} Jun 03 15:45:13.431826 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:13.431431 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"799a2133-99bd-4bc7-a172-2a9251261c03","Type":"ContainerStarted","Data":"bb0a9c23cc60c43d3f61c03ed53ab0830406130e06157e455e98516b8433f515"} Jun 03 15:45:13.465620 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:13.465557 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.465539338 podStartE2EDuration="2.465539338s" podCreationTimestamp="2026-06-03 15:45:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:45:13.464274236 +0000 UTC m=+265.460573362" watchObservedRunningTime="2026-06-03 15:45:13.465539338 +0000 UTC m=+265.461838466" Jun 03 15:45:16.796081 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:16.796021 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:45:27.142184 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:27.142084 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7d886dbc-fxqm5"] Jun 03 15:45:48.424780 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:48.424748 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 15:45:48.426382 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:48.426355 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 15:45:48.442698 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:48.442672 2566 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 15:45:52.163039 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.162974 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6f7d886dbc-fxqm5" podUID="38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" containerName="console" containerID="cri-o://a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f" gracePeriod=15 Jun 03 15:45:52.409731 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.409707 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f7d886dbc-fxqm5_38cf5e19-ff8b-4173-bbc3-4ecee8e0c716/console/0.log" Jun 03 15:45:52.409863 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.409766 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:45:52.456766 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.456729 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-trusted-ca-bundle\") pod \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " Jun 03 15:45:52.456976 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.456819 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hsds\" (UniqueName: \"kubernetes.io/projected/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-kube-api-access-4hsds\") pod \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " Jun 03 15:45:52.456976 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.456853 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-config\") pod \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " Jun 03 15:45:52.456976 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.456886 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-serving-cert\") pod \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " Jun 03 15:45:52.456976 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.456960 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-service-ca\") pod \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " Jun 03 15:45:52.456976 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.456976 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-oauth-serving-cert\") pod \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " Jun 03 15:45:52.457238 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.457000 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-oauth-config\") pod \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\" (UID: \"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716\") " Jun 03 15:45:52.458091 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.457224 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" (UID: "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:52.458091 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.457668 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" (UID: "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:52.458091 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.457709 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-config" (OuterVolumeSpecName: "console-config") pod "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" (UID: "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:52.458091 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.457758 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-service-ca" (OuterVolumeSpecName: "service-ca") pod "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" (UID: "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:45:52.464398 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.464366 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" (UID: "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:52.464538 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.464358 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" (UID: "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:45:52.464586 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.464538 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-kube-api-access-4hsds" (OuterVolumeSpecName: "kube-api-access-4hsds") pod "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" (UID: "38cf5e19-ff8b-4173-bbc3-4ecee8e0c716"). InnerVolumeSpecName "kube-api-access-4hsds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:45:52.558192 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.558161 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-trusted-ca-bundle\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:52.558192 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.558192 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hsds\" (UniqueName: \"kubernetes.io/projected/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-kube-api-access-4hsds\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:52.558361 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.558202 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-config\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:52.558361 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.558211 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-serving-cert\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:52.558361 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.558220 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-service-ca\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:52.558361 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.558228 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-oauth-serving-cert\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:52.558361 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.558237 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716-console-oauth-config\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:45:52.565572 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.565550 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f7d886dbc-fxqm5_38cf5e19-ff8b-4173-bbc3-4ecee8e0c716/console/0.log" Jun 03 15:45:52.565734 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.565589 2566 generic.go:358] "Generic (PLEG): container finished" podID="38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" containerID="a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f" exitCode=2 Jun 03 15:45:52.565734 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.565677 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7d886dbc-fxqm5" event={"ID":"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716","Type":"ContainerDied","Data":"a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f"} Jun 03 15:45:52.565734 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.565696 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7d886dbc-fxqm5" Jun 03 15:45:52.565734 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.565714 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7d886dbc-fxqm5" event={"ID":"38cf5e19-ff8b-4173-bbc3-4ecee8e0c716","Type":"ContainerDied","Data":"9030b4a88533630ae16a8e4e04a7c10537c287707321ecab4c00c67aa99e8cb1"} Jun 03 15:45:52.565734 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.565730 2566 scope.go:117] "RemoveContainer" containerID="a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f" Jun 03 15:45:52.573858 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.573836 2566 scope.go:117] "RemoveContainer" containerID="a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f" Jun 03 15:45:52.574221 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:45:52.574200 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f\": container with ID starting with a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f not found: ID does not exist" containerID="a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f" Jun 03 15:45:52.574304 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.574227 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f"} err="failed to get container status \"a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f\": rpc error: code = NotFound desc = could not find container \"a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f\": container with ID starting with a13507ef5a12ceaf130e52b57e6a90d9a6c5c8b07747276a29e027f08a25a47f not found: ID does not exist" Jun 03 15:45:52.586895 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.586856 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7d886dbc-fxqm5"] Jun 03 15:45:52.592956 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:52.592917 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f7d886dbc-fxqm5"] Jun 03 15:45:54.543161 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:45:54.543120 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" path="/var/lib/kubelet/pods/38cf5e19-ff8b-4173-bbc3-4ecee8e0c716/volumes" Jun 03 15:46:11.796472 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:11.796430 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:46:11.812259 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:11.812231 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:46:12.643547 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:12.643519 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:46:38.281619 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.281524 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-dx79c"] Jun 03 15:46:38.282221 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.282079 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" containerName="console" Jun 03 15:46:38.282221 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.282101 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" containerName="console" Jun 03 15:46:38.282221 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.282187 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="38cf5e19-ff8b-4173-bbc3-4ecee8e0c716" containerName="console" Jun 03 15:46:38.284992 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.284969 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-dx79c" Jun 03 15:46:38.287955 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.287922 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 15:46:38.288081 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.287924 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 15:46:38.288081 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.287938 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6vjr2\"" Jun 03 15:46:38.297845 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.297812 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-dx79c"] Jun 03 15:46:38.374460 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.374423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7f94777-bdb4-4d14-9879-2352b5bc36d4-bound-sa-token\") pod \"cert-manager-79c8d999ff-dx79c\" (UID: \"b7f94777-bdb4-4d14-9879-2352b5bc36d4\") " pod="cert-manager/cert-manager-79c8d999ff-dx79c" Jun 03 15:46:38.374645 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.374485 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx9wv\" (UniqueName: \"kubernetes.io/projected/b7f94777-bdb4-4d14-9879-2352b5bc36d4-kube-api-access-bx9wv\") pod \"cert-manager-79c8d999ff-dx79c\" (UID: \"b7f94777-bdb4-4d14-9879-2352b5bc36d4\") " pod="cert-manager/cert-manager-79c8d999ff-dx79c" Jun 03 15:46:38.475509 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.475455 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7f94777-bdb4-4d14-9879-2352b5bc36d4-bound-sa-token\") pod \"cert-manager-79c8d999ff-dx79c\" (UID: \"b7f94777-bdb4-4d14-9879-2352b5bc36d4\") " pod="cert-manager/cert-manager-79c8d999ff-dx79c" Jun 03 15:46:38.475697 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.475628 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx9wv\" (UniqueName: \"kubernetes.io/projected/b7f94777-bdb4-4d14-9879-2352b5bc36d4-kube-api-access-bx9wv\") pod \"cert-manager-79c8d999ff-dx79c\" (UID: \"b7f94777-bdb4-4d14-9879-2352b5bc36d4\") " pod="cert-manager/cert-manager-79c8d999ff-dx79c" Jun 03 15:46:38.486441 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.486384 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7f94777-bdb4-4d14-9879-2352b5bc36d4-bound-sa-token\") pod \"cert-manager-79c8d999ff-dx79c\" (UID: \"b7f94777-bdb4-4d14-9879-2352b5bc36d4\") " pod="cert-manager/cert-manager-79c8d999ff-dx79c" Jun 03 15:46:38.486582 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.486462 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx9wv\" (UniqueName: \"kubernetes.io/projected/b7f94777-bdb4-4d14-9879-2352b5bc36d4-kube-api-access-bx9wv\") pod \"cert-manager-79c8d999ff-dx79c\" (UID: \"b7f94777-bdb4-4d14-9879-2352b5bc36d4\") " pod="cert-manager/cert-manager-79c8d999ff-dx79c" Jun 03 15:46:38.593984 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.593865 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-dx79c" Jun 03 15:46:38.730273 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.730238 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-dx79c"] Jun 03 15:46:38.733147 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:46:38.733109 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7f94777_bdb4_4d14_9879_2352b5bc36d4.slice/crio-a5fb4bf257494f65c36023841ac9eefd3c942704b2515336332dcdb7d28080e1 WatchSource:0}: Error finding container a5fb4bf257494f65c36023841ac9eefd3c942704b2515336332dcdb7d28080e1: Status 404 returned error can't find the container with id a5fb4bf257494f65c36023841ac9eefd3c942704b2515336332dcdb7d28080e1 Jun 03 15:46:38.735012 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:38.734992 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:46:39.713526 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:39.713485 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-dx79c" event={"ID":"b7f94777-bdb4-4d14-9879-2352b5bc36d4","Type":"ContainerStarted","Data":"a5fb4bf257494f65c36023841ac9eefd3c942704b2515336332dcdb7d28080e1"} Jun 03 15:46:42.726093 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:42.726055 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-dx79c" event={"ID":"b7f94777-bdb4-4d14-9879-2352b5bc36d4","Type":"ContainerStarted","Data":"e8e241e399c3a98a43885c3fad7a43dd67a9aa68df3df42fba139fa2744a177e"} Jun 03 15:46:42.745723 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:46:42.745666 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-dx79c" podStartSLOduration=1.447054494 podStartE2EDuration="4.745651546s" podCreationTimestamp="2026-06-03 15:46:38 +0000 UTC" firstStartedPulling="2026-06-03 15:46:38.735124066 +0000 UTC m=+350.731423184" lastFinishedPulling="2026-06-03 15:46:42.033721131 +0000 UTC m=+354.030020236" observedRunningTime="2026-06-03 15:46:42.743457208 +0000 UTC m=+354.739756331" watchObservedRunningTime="2026-06-03 15:46:42.745651546 +0000 UTC m=+354.741950672" Jun 03 15:47:03.525280 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.525247 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5"] Jun 03 15:47:03.530167 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.530149 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.534428 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.534400 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 15:47:03.534568 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.534465 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fbrvd\"" Jun 03 15:47:03.534632 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.534614 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 15:47:03.535634 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.535610 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 15:47:03.535756 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.535737 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 15:47:03.549014 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.548990 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5"] Jun 03 15:47:03.716120 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.716078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2bd59ab-2846-47e8-8060-6580af41af79-manifests\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.716120 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.716124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2bd59ab-2846-47e8-8060-6580af41af79-webhook-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.716348 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.716156 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jzgj\" (UniqueName: \"kubernetes.io/projected/b2bd59ab-2846-47e8-8060-6580af41af79-kube-api-access-4jzgj\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.716348 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.716236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2bd59ab-2846-47e8-8060-6580af41af79-tmp\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.716348 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.716335 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2bd59ab-2846-47e8-8060-6580af41af79-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.817458 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.817347 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jzgj\" (UniqueName: \"kubernetes.io/projected/b2bd59ab-2846-47e8-8060-6580af41af79-kube-api-access-4jzgj\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.817458 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.817421 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2bd59ab-2846-47e8-8060-6580af41af79-tmp\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.817694 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.817503 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2bd59ab-2846-47e8-8060-6580af41af79-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.817694 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.817547 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2bd59ab-2846-47e8-8060-6580af41af79-manifests\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.817694 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.817579 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2bd59ab-2846-47e8-8060-6580af41af79-webhook-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.818034 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.818011 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2bd59ab-2846-47e8-8060-6580af41af79-manifests\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.819996 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.819974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2bd59ab-2846-47e8-8060-6580af41af79-tmp\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.820180 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.820161 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2bd59ab-2846-47e8-8060-6580af41af79-webhook-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.820247 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.820181 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2bd59ab-2846-47e8-8060-6580af41af79-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.836818 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.836789 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jzgj\" (UniqueName: \"kubernetes.io/projected/b2bd59ab-2846-47e8-8060-6580af41af79-kube-api-access-4jzgj\") pod \"opendatahub-operator-controller-manager-548f4487f9-xcpg5\" (UID: \"b2bd59ab-2846-47e8-8060-6580af41af79\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.840712 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.840688 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:03.994796 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:03.994741 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5"] Jun 03 15:47:03.999454 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:47:03.999419 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bd59ab_2846_47e8_8060_6580af41af79.slice/crio-e057034823bc089b9b47f933c55817d16f47d8861cfe327e2c0358954e8a029b WatchSource:0}: Error finding container e057034823bc089b9b47f933c55817d16f47d8861cfe327e2c0358954e8a029b: Status 404 returned error can't find the container with id e057034823bc089b9b47f933c55817d16f47d8861cfe327e2c0358954e8a029b Jun 03 15:47:04.799460 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:04.799421 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" event={"ID":"b2bd59ab-2846-47e8-8060-6580af41af79","Type":"ContainerStarted","Data":"e057034823bc089b9b47f933c55817d16f47d8861cfe327e2c0358954e8a029b"} Jun 03 15:47:07.811206 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:07.811170 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" event={"ID":"b2bd59ab-2846-47e8-8060-6580af41af79","Type":"ContainerStarted","Data":"bc414a9439a46a6906352dab48b884100216be97cb13334bde18b1589b642479"} Jun 03 15:47:08.816206 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:08.816167 2566 generic.go:358] "Generic (PLEG): container finished" podID="b2bd59ab-2846-47e8-8060-6580af41af79" containerID="bc414a9439a46a6906352dab48b884100216be97cb13334bde18b1589b642479" exitCode=0 Jun 03 15:47:08.816694 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:08.816249 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" event={"ID":"b2bd59ab-2846-47e8-8060-6580af41af79","Type":"ContainerDied","Data":"bc414a9439a46a6906352dab48b884100216be97cb13334bde18b1589b642479"} Jun 03 15:47:09.821849 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:09.821804 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" event={"ID":"b2bd59ab-2846-47e8-8060-6580af41af79","Type":"ContainerStarted","Data":"d7bd6732a4932af851b1b9ac05a213a1c3781880c8661f150297de1fafccf464"} Jun 03 15:47:09.822258 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:09.821993 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:09.860358 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:09.860304 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" podStartSLOduration=1.7224623129999999 podStartE2EDuration="6.860283s" podCreationTimestamp="2026-06-03 15:47:03 +0000 UTC" firstStartedPulling="2026-06-03 15:47:04.001254503 +0000 UTC m=+375.997553608" lastFinishedPulling="2026-06-03 15:47:09.139075176 +0000 UTC m=+381.135374295" observedRunningTime="2026-06-03 15:47:09.85574664 +0000 UTC m=+381.852045778" watchObservedRunningTime="2026-06-03 15:47:09.860283 +0000 UTC m=+381.856582126" Jun 03 15:47:20.827245 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:20.827213 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-xcpg5" Jun 03 15:47:32.011181 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.011139 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w"] Jun 03 15:47:32.020951 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.020901 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.024526 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.024495 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 15:47:32.024731 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.024654 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:47:32.024731 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.024514 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 15:47:32.024731 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.024701 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 15:47:32.024731 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.024517 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q87fn\"" Jun 03 15:47:32.025041 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.024508 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 15:47:32.025098 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.025037 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w"] Jun 03 15:47:32.066315 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.066281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b65943bf-1a54-47dc-805a-74730259eef1-manager-config\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.066315 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.066319 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b65943bf-1a54-47dc-805a-74730259eef1-metrics-cert\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.066528 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.066394 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2prkl\" (UniqueName: \"kubernetes.io/projected/b65943bf-1a54-47dc-805a-74730259eef1-kube-api-access-2prkl\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.066528 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.066429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b65943bf-1a54-47dc-805a-74730259eef1-cert\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.167387 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.167350 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b65943bf-1a54-47dc-805a-74730259eef1-manager-config\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.167578 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.167404 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b65943bf-1a54-47dc-805a-74730259eef1-metrics-cert\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.167578 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.167443 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2prkl\" (UniqueName: \"kubernetes.io/projected/b65943bf-1a54-47dc-805a-74730259eef1-kube-api-access-2prkl\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.167578 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.167481 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b65943bf-1a54-47dc-805a-74730259eef1-cert\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.168219 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.168191 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b65943bf-1a54-47dc-805a-74730259eef1-manager-config\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.170231 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.170201 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b65943bf-1a54-47dc-805a-74730259eef1-metrics-cert\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.170405 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.170385 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b65943bf-1a54-47dc-805a-74730259eef1-cert\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.182655 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.182619 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2prkl\" (UniqueName: \"kubernetes.io/projected/b65943bf-1a54-47dc-805a-74730259eef1-kube-api-access-2prkl\") pod \"lws-controller-manager-f96cfff67-2vb8w\" (UID: \"b65943bf-1a54-47dc-805a-74730259eef1\") " pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.332443 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.332336 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:32.518080 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.518038 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w"] Jun 03 15:47:32.520889 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:47:32.520857 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65943bf_1a54_47dc_805a_74730259eef1.slice/crio-74a8a1a6ce89a0b8d0281a6c67f27afe588c979ef1765d33260e65e3ea776fc7 WatchSource:0}: Error finding container 74a8a1a6ce89a0b8d0281a6c67f27afe588c979ef1765d33260e65e3ea776fc7: Status 404 returned error can't find the container with id 74a8a1a6ce89a0b8d0281a6c67f27afe588c979ef1765d33260e65e3ea776fc7 Jun 03 15:47:32.896862 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:32.896824 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" event={"ID":"b65943bf-1a54-47dc-805a-74730259eef1","Type":"ContainerStarted","Data":"74a8a1a6ce89a0b8d0281a6c67f27afe588c979ef1765d33260e65e3ea776fc7"} Jun 03 15:47:33.621257 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.621221 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z"] Jun 03 15:47:33.626076 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.626055 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.630917 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.630893 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 15:47:33.631834 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.631810 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qwt86\"" Jun 03 15:47:33.632003 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.631810 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 15:47:33.648981 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.648947 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 15:47:33.649150 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.649069 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 15:47:33.663341 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.663310 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z"] Jun 03 15:47:33.681681 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.681646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq25s\" (UniqueName: \"kubernetes.io/projected/3f07efa3-9184-423c-9b18-480a89062b94-kube-api-access-cq25s\") pod \"kube-auth-proxy-6cc4c89bc4-jkm5z\" (UID: \"3f07efa3-9184-423c-9b18-480a89062b94\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.681862 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.681693 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f07efa3-9184-423c-9b18-480a89062b94-tls-certs\") pod \"kube-auth-proxy-6cc4c89bc4-jkm5z\" (UID: \"3f07efa3-9184-423c-9b18-480a89062b94\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.681911 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.681892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f07efa3-9184-423c-9b18-480a89062b94-tmp\") pod \"kube-auth-proxy-6cc4c89bc4-jkm5z\" (UID: \"3f07efa3-9184-423c-9b18-480a89062b94\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.782901 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.782860 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cq25s\" (UniqueName: \"kubernetes.io/projected/3f07efa3-9184-423c-9b18-480a89062b94-kube-api-access-cq25s\") pod \"kube-auth-proxy-6cc4c89bc4-jkm5z\" (UID: \"3f07efa3-9184-423c-9b18-480a89062b94\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.782901 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.782907 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f07efa3-9184-423c-9b18-480a89062b94-tls-certs\") pod \"kube-auth-proxy-6cc4c89bc4-jkm5z\" (UID: \"3f07efa3-9184-423c-9b18-480a89062b94\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.783124 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.782946 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f07efa3-9184-423c-9b18-480a89062b94-tmp\") pod \"kube-auth-proxy-6cc4c89bc4-jkm5z\" (UID: \"3f07efa3-9184-423c-9b18-480a89062b94\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.785317 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.785285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f07efa3-9184-423c-9b18-480a89062b94-tmp\") pod \"kube-auth-proxy-6cc4c89bc4-jkm5z\" (UID: \"3f07efa3-9184-423c-9b18-480a89062b94\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.785444 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.785363 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f07efa3-9184-423c-9b18-480a89062b94-tls-certs\") pod \"kube-auth-proxy-6cc4c89bc4-jkm5z\" (UID: \"3f07efa3-9184-423c-9b18-480a89062b94\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.797455 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.797430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq25s\" (UniqueName: \"kubernetes.io/projected/3f07efa3-9184-423c-9b18-480a89062b94-kube-api-access-cq25s\") pod \"kube-auth-proxy-6cc4c89bc4-jkm5z\" (UID: \"3f07efa3-9184-423c-9b18-480a89062b94\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:33.942612 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:33.942518 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" Jun 03 15:47:34.077982 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:34.077947 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z"] Jun 03 15:47:34.081246 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:47:34.081216 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f07efa3_9184_423c_9b18_480a89062b94.slice/crio-4b848594f6bbaed363359a6f4d1b49b36bf6d1ff09d04936686357a5a577af30 WatchSource:0}: Error finding container 4b848594f6bbaed363359a6f4d1b49b36bf6d1ff09d04936686357a5a577af30: Status 404 returned error can't find the container with id 4b848594f6bbaed363359a6f4d1b49b36bf6d1ff09d04936686357a5a577af30 Jun 03 15:47:34.907182 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:34.907110 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" event={"ID":"3f07efa3-9184-423c-9b18-480a89062b94","Type":"ContainerStarted","Data":"4b848594f6bbaed363359a6f4d1b49b36bf6d1ff09d04936686357a5a577af30"} Jun 03 15:47:37.920492 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:37.920453 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" event={"ID":"b65943bf-1a54-47dc-805a-74730259eef1","Type":"ContainerStarted","Data":"12d498d75f86db8aeaef20e55f407a5ce090c5d06bfc13d11fb71e4513d5a8a7"} Jun 03 15:47:37.920894 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:37.920529 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:47:37.948552 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:37.948492 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" podStartSLOduration=1.681425452 podStartE2EDuration="6.948474584s" podCreationTimestamp="2026-06-03 15:47:31 +0000 UTC" firstStartedPulling="2026-06-03 15:47:32.52265427 +0000 UTC m=+404.518953388" lastFinishedPulling="2026-06-03 15:47:37.789703416 +0000 UTC m=+409.786002520" observedRunningTime="2026-06-03 15:47:37.946221562 +0000 UTC m=+409.942520705" watchObservedRunningTime="2026-06-03 15:47:37.948474584 +0000 UTC m=+409.944773710" Jun 03 15:47:38.925240 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:38.925190 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" event={"ID":"3f07efa3-9184-423c-9b18-480a89062b94","Type":"ContainerStarted","Data":"fb285066bfc0cf8cea7bee755f6befdfbf22653b14e4dcab17b7f4509b4d9e00"} Jun 03 15:47:38.946050 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:38.945987 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-jkm5z" podStartSLOduration=2.041767185 podStartE2EDuration="5.945972528s" podCreationTimestamp="2026-06-03 15:47:33 +0000 UTC" firstStartedPulling="2026-06-03 15:47:34.083037564 +0000 UTC m=+406.079336682" lastFinishedPulling="2026-06-03 15:47:37.987242905 +0000 UTC m=+409.983542025" observedRunningTime="2026-06-03 15:47:38.943299544 +0000 UTC m=+410.939598685" watchObservedRunningTime="2026-06-03 15:47:38.945972528 +0000 UTC m=+410.942271655" Jun 03 15:47:48.928100 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:47:48.928068 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f96cfff67-2vb8w" Jun 03 15:49:08.055325 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.055285 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-fjmck"] Jun 03 15:49:08.058608 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.058586 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-fjmck" Jun 03 15:49:08.061320 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.061289 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:49:08.061454 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.061434 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:49:08.062346 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.062327 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8svlf\"" Jun 03 15:49:08.069125 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.069098 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-fjmck"] Jun 03 15:49:08.135894 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.135861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxn8w\" (UniqueName: \"kubernetes.io/projected/b911ddd3-23df-44cb-a61b-99e1d7c0190d-kube-api-access-kxn8w\") pod \"authorino-operator-657f44b778-fjmck\" (UID: \"b911ddd3-23df-44cb-a61b-99e1d7c0190d\") " pod="kuadrant-system/authorino-operator-657f44b778-fjmck" Jun 03 15:49:08.237120 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.237091 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxn8w\" (UniqueName: \"kubernetes.io/projected/b911ddd3-23df-44cb-a61b-99e1d7c0190d-kube-api-access-kxn8w\") pod \"authorino-operator-657f44b778-fjmck\" (UID: \"b911ddd3-23df-44cb-a61b-99e1d7c0190d\") " pod="kuadrant-system/authorino-operator-657f44b778-fjmck" Jun 03 15:49:08.259315 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.259278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxn8w\" (UniqueName: \"kubernetes.io/projected/b911ddd3-23df-44cb-a61b-99e1d7c0190d-kube-api-access-kxn8w\") pod \"authorino-operator-657f44b778-fjmck\" (UID: \"b911ddd3-23df-44cb-a61b-99e1d7c0190d\") " pod="kuadrant-system/authorino-operator-657f44b778-fjmck" Jun 03 15:49:08.370158 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.370061 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-fjmck" Jun 03 15:49:08.521455 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:08.521425 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-fjmck"] Jun 03 15:49:08.523365 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:49:08.523335 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb911ddd3_23df_44cb_a61b_99e1d7c0190d.slice/crio-80dbef3654fccfd855043e9da06d0736b4fa56fea675722cf4aef434ca7d0ba1 WatchSource:0}: Error finding container 80dbef3654fccfd855043e9da06d0736b4fa56fea675722cf4aef434ca7d0ba1: Status 404 returned error can't find the container with id 80dbef3654fccfd855043e9da06d0736b4fa56fea675722cf4aef434ca7d0ba1 Jun 03 15:49:09.239334 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:09.239291 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-fjmck" event={"ID":"b911ddd3-23df-44cb-a61b-99e1d7c0190d","Type":"ContainerStarted","Data":"80dbef3654fccfd855043e9da06d0736b4fa56fea675722cf4aef434ca7d0ba1"} Jun 03 15:49:11.248740 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:11.248705 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-fjmck" event={"ID":"b911ddd3-23df-44cb-a61b-99e1d7c0190d","Type":"ContainerStarted","Data":"02e0d52690c4ed560d953290a47244b4a2ac6042660d3b5c0afbf2ce69dddf76"} Jun 03 15:49:11.249200 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:11.248828 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-fjmck" Jun 03 15:49:11.266765 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:11.266543 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-fjmck" podStartSLOduration=1.098356052 podStartE2EDuration="3.266523825s" podCreationTimestamp="2026-06-03 15:49:08 +0000 UTC" firstStartedPulling="2026-06-03 15:49:08.525242947 +0000 UTC m=+500.521542052" lastFinishedPulling="2026-06-03 15:49:10.693410716 +0000 UTC m=+502.689709825" observedRunningTime="2026-06-03 15:49:11.266278972 +0000 UTC m=+503.262578102" watchObservedRunningTime="2026-06-03 15:49:11.266523825 +0000 UTC m=+503.262822952" Jun 03 15:49:22.254579 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:22.254542 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-fjmck" Jun 03 15:49:57.668347 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:57.668311 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5lhv2"] Jun 03 15:49:57.672087 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:57.672063 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" Jun 03 15:49:57.674815 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:57.674788 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hp85c\"" Jun 03 15:49:57.684583 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:57.684529 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5lhv2"] Jun 03 15:49:57.801553 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:57.801515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7qv2\" (UniqueName: \"kubernetes.io/projected/aaf4b297-d273-4f92-ac9f-74704fd0b83c-kube-api-access-w7qv2\") pod \"authorino-f99f4b5cd-5lhv2\" (UID: \"aaf4b297-d273-4f92-ac9f-74704fd0b83c\") " pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" Jun 03 15:49:57.902239 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:57.902198 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7qv2\" (UniqueName: \"kubernetes.io/projected/aaf4b297-d273-4f92-ac9f-74704fd0b83c-kube-api-access-w7qv2\") pod \"authorino-f99f4b5cd-5lhv2\" (UID: \"aaf4b297-d273-4f92-ac9f-74704fd0b83c\") " pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" Jun 03 15:49:57.912630 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:57.912598 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7qv2\" (UniqueName: \"kubernetes.io/projected/aaf4b297-d273-4f92-ac9f-74704fd0b83c-kube-api-access-w7qv2\") pod \"authorino-f99f4b5cd-5lhv2\" (UID: \"aaf4b297-d273-4f92-ac9f-74704fd0b83c\") " pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" Jun 03 15:49:57.982422 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:57.982388 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" Jun 03 15:49:58.116562 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:58.116538 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5lhv2"] Jun 03 15:49:58.119294 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:49:58.119263 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaaf4b297_d273_4f92_ac9f_74704fd0b83c.slice/crio-b6bcfeabb1550cdcc77e12fff14f5437e9de410d4a3a07e58fc2ccdd29b1000b WatchSource:0}: Error finding container b6bcfeabb1550cdcc77e12fff14f5437e9de410d4a3a07e58fc2ccdd29b1000b: Status 404 returned error can't find the container with id b6bcfeabb1550cdcc77e12fff14f5437e9de410d4a3a07e58fc2ccdd29b1000b Jun 03 15:49:58.414799 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:49:58.414701 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" event={"ID":"aaf4b297-d273-4f92-ac9f-74704fd0b83c","Type":"ContainerStarted","Data":"b6bcfeabb1550cdcc77e12fff14f5437e9de410d4a3a07e58fc2ccdd29b1000b"} Jun 03 15:50:02.431033 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:02.430994 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" event={"ID":"aaf4b297-d273-4f92-ac9f-74704fd0b83c","Type":"ContainerStarted","Data":"1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16"} Jun 03 15:50:02.450124 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:02.450077 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" podStartSLOduration=1.981826892 podStartE2EDuration="5.4500621s" podCreationTimestamp="2026-06-03 15:49:57 +0000 UTC" firstStartedPulling="2026-06-03 15:49:58.120431244 +0000 UTC m=+550.116730348" lastFinishedPulling="2026-06-03 15:50:01.588666422 +0000 UTC m=+553.584965556" observedRunningTime="2026-06-03 15:50:02.44824653 +0000 UTC m=+554.444545660" watchObservedRunningTime="2026-06-03 15:50:02.4500621 +0000 UTC m=+554.446361227" Jun 03 15:50:03.827165 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:03.827123 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5lhv2"] Jun 03 15:50:04.437904 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:04.437859 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" podUID="aaf4b297-d273-4f92-ac9f-74704fd0b83c" containerName="authorino" containerID="cri-o://1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16" gracePeriod=30 Jun 03 15:50:04.686118 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:04.686089 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" Jun 03 15:50:04.758186 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:04.758149 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7qv2\" (UniqueName: \"kubernetes.io/projected/aaf4b297-d273-4f92-ac9f-74704fd0b83c-kube-api-access-w7qv2\") pod \"aaf4b297-d273-4f92-ac9f-74704fd0b83c\" (UID: \"aaf4b297-d273-4f92-ac9f-74704fd0b83c\") " Jun 03 15:50:04.760404 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:04.760368 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf4b297-d273-4f92-ac9f-74704fd0b83c-kube-api-access-w7qv2" (OuterVolumeSpecName: "kube-api-access-w7qv2") pod "aaf4b297-d273-4f92-ac9f-74704fd0b83c" (UID: "aaf4b297-d273-4f92-ac9f-74704fd0b83c"). InnerVolumeSpecName "kube-api-access-w7qv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:50:04.859469 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:04.859432 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7qv2\" (UniqueName: \"kubernetes.io/projected/aaf4b297-d273-4f92-ac9f-74704fd0b83c-kube-api-access-w7qv2\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:50:05.441917 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:05.441875 2566 generic.go:358] "Generic (PLEG): container finished" podID="aaf4b297-d273-4f92-ac9f-74704fd0b83c" containerID="1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16" exitCode=0 Jun 03 15:50:05.442143 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:05.441921 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" event={"ID":"aaf4b297-d273-4f92-ac9f-74704fd0b83c","Type":"ContainerDied","Data":"1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16"} Jun 03 15:50:05.442143 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:05.441976 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" event={"ID":"aaf4b297-d273-4f92-ac9f-74704fd0b83c","Type":"ContainerDied","Data":"b6bcfeabb1550cdcc77e12fff14f5437e9de410d4a3a07e58fc2ccdd29b1000b"} Jun 03 15:50:05.442143 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:05.441991 2566 scope.go:117] "RemoveContainer" containerID="1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16" Jun 03 15:50:05.442143 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:05.441946 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5lhv2" Jun 03 15:50:05.452355 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:05.452331 2566 scope.go:117] "RemoveContainer" containerID="1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16" Jun 03 15:50:05.452597 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:50:05.452578 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16\": container with ID starting with 1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16 not found: ID does not exist" containerID="1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16" Jun 03 15:50:05.452644 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:05.452609 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16"} err="failed to get container status \"1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16\": rpc error: code = NotFound desc = could not find container \"1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16\": container with ID starting with 1dfbc430ee095fb08932e38d8033c017aeae9e8c7b169658be09bbcd6ca72e16 not found: ID does not exist" Jun 03 15:50:05.467496 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:05.467457 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5lhv2"] Jun 03 15:50:05.471998 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:05.471967 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5lhv2"] Jun 03 15:50:06.542895 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:06.542857 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf4b297-d273-4f92-ac9f-74704fd0b83c" path="/var/lib/kubelet/pods/aaf4b297-d273-4f92-ac9f-74704fd0b83c/volumes" Jun 03 15:50:36.736718 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.736685 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-z99gn"] Jun 03 15:50:36.737245 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.737153 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf4b297-d273-4f92-ac9f-74704fd0b83c" containerName="authorino" Jun 03 15:50:36.737245 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.737168 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf4b297-d273-4f92-ac9f-74704fd0b83c" containerName="authorino" Jun 03 15:50:36.737245 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.737231 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="aaf4b297-d273-4f92-ac9f-74704fd0b83c" containerName="authorino" Jun 03 15:50:36.742682 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.742658 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-z99gn" Jun 03 15:50:36.746335 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.746310 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 15:50:36.746335 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.746330 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 15:50:36.748454 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.748435 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-87g8l\"" Jun 03 15:50:36.757950 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.757900 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-z99gn"] Jun 03 15:50:36.854408 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.854364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52gq5\" (UniqueName: \"kubernetes.io/projected/ba736fe5-d9d5-4180-ba28-1f8e68ffd636-kube-api-access-52gq5\") pod \"keycloak-operator-7864d68cbd-z99gn\" (UID: \"ba736fe5-d9d5-4180-ba28-1f8e68ffd636\") " pod="keycloak-system/keycloak-operator-7864d68cbd-z99gn" Jun 03 15:50:36.955411 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.955363 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52gq5\" (UniqueName: \"kubernetes.io/projected/ba736fe5-d9d5-4180-ba28-1f8e68ffd636-kube-api-access-52gq5\") pod \"keycloak-operator-7864d68cbd-z99gn\" (UID: \"ba736fe5-d9d5-4180-ba28-1f8e68ffd636\") " pod="keycloak-system/keycloak-operator-7864d68cbd-z99gn" Jun 03 15:50:36.966815 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:36.966787 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52gq5\" (UniqueName: \"kubernetes.io/projected/ba736fe5-d9d5-4180-ba28-1f8e68ffd636-kube-api-access-52gq5\") pod \"keycloak-operator-7864d68cbd-z99gn\" (UID: \"ba736fe5-d9d5-4180-ba28-1f8e68ffd636\") " pod="keycloak-system/keycloak-operator-7864d68cbd-z99gn" Jun 03 15:50:37.053167 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:37.053066 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-z99gn" Jun 03 15:50:37.199234 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:37.199200 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-z99gn"] Jun 03 15:50:37.200417 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:50:37.200389 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba736fe5_d9d5_4180_ba28_1f8e68ffd636.slice/crio-d4f2746717bf4722ab569cb791a52e894873dc2f90db52fd4efb59d19833eb80 WatchSource:0}: Error finding container d4f2746717bf4722ab569cb791a52e894873dc2f90db52fd4efb59d19833eb80: Status 404 returned error can't find the container with id d4f2746717bf4722ab569cb791a52e894873dc2f90db52fd4efb59d19833eb80 Jun 03 15:50:37.555688 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:37.555646 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-z99gn" event={"ID":"ba736fe5-d9d5-4180-ba28-1f8e68ffd636","Type":"ContainerStarted","Data":"d4f2746717bf4722ab569cb791a52e894873dc2f90db52fd4efb59d19833eb80"} Jun 03 15:50:44.588077 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:44.588031 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-z99gn" event={"ID":"ba736fe5-d9d5-4180-ba28-1f8e68ffd636","Type":"ContainerStarted","Data":"4a36a802a609cd496f0289c1f20177fb16164b9c0216b5f0dd69b5b34ca968d1"} Jun 03 15:50:44.606447 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:44.606392 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-z99gn" podStartSLOduration=2.190650549 podStartE2EDuration="8.606377488s" podCreationTimestamp="2026-06-03 15:50:36 +0000 UTC" firstStartedPulling="2026-06-03 15:50:37.201806958 +0000 UTC m=+589.198106063" lastFinishedPulling="2026-06-03 15:50:43.617533887 +0000 UTC m=+595.613833002" observedRunningTime="2026-06-03 15:50:44.605505522 +0000 UTC m=+596.601804650" watchObservedRunningTime="2026-06-03 15:50:44.606377488 +0000 UTC m=+596.602676614" Jun 03 15:50:48.461789 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:48.461754 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 15:50:48.462302 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:50:48.461986 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 15:51:23.716100 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.716046 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-789pb"] Jun 03 15:51:23.723485 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.723465 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-789pb" Jun 03 15:51:23.726100 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.726079 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hp85c\"" Jun 03 15:51:23.729733 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.729705 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-789pb"] Jun 03 15:51:23.898526 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.898491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqp6h\" (UniqueName: \"kubernetes.io/projected/c409113a-1f36-4915-a443-346c37ced09a-kube-api-access-cqp6h\") pod \"authorino-8b475cf9f-789pb\" (UID: \"c409113a-1f36-4915-a443-346c37ced09a\") " pod="kuadrant-system/authorino-8b475cf9f-789pb" Jun 03 15:51:23.940047 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.940011 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-789pb"] Jun 03 15:51:23.940312 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:51:23.940291 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cqp6h], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-789pb" podUID="c409113a-1f36-4915-a443-346c37ced09a" Jun 03 15:51:23.966940 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.966829 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d94db7c54-pfzc4"] Jun 03 15:51:23.970316 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.970289 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d94db7c54-pfzc4" Jun 03 15:51:23.977635 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.977608 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d94db7c54-pfzc4"] Jun 03 15:51:24.000034 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:23.999998 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqp6h\" (UniqueName: \"kubernetes.io/projected/c409113a-1f36-4915-a443-346c37ced09a-kube-api-access-cqp6h\") pod \"authorino-8b475cf9f-789pb\" (UID: \"c409113a-1f36-4915-a443-346c37ced09a\") " pod="kuadrant-system/authorino-8b475cf9f-789pb" Jun 03 15:51:24.009544 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.009513 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqp6h\" (UniqueName: \"kubernetes.io/projected/c409113a-1f36-4915-a443-346c37ced09a-kube-api-access-cqp6h\") pod \"authorino-8b475cf9f-789pb\" (UID: \"c409113a-1f36-4915-a443-346c37ced09a\") " pod="kuadrant-system/authorino-8b475cf9f-789pb" Jun 03 15:51:24.076760 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.076722 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d94db7c54-pfzc4"] Jun 03 15:51:24.077040 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:51:24.077019 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d5jck], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-d94db7c54-pfzc4" podUID="0c320497-5e8d-42cd-b617-589aff98aa47" Jun 03 15:51:24.101358 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.101317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5jck\" (UniqueName: \"kubernetes.io/projected/0c320497-5e8d-42cd-b617-589aff98aa47-kube-api-access-d5jck\") pod \"authorino-d94db7c54-pfzc4\" (UID: \"0c320497-5e8d-42cd-b617-589aff98aa47\") " pod="kuadrant-system/authorino-d94db7c54-pfzc4" Jun 03 15:51:24.118212 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.118180 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cfbb84bf4-xptwq"] Jun 03 15:51:24.121519 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.121491 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:51:24.124141 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.124122 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 15:51:24.129522 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.129499 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cfbb84bf4-xptwq"] Jun 03 15:51:24.202864 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.202826 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5jck\" (UniqueName: \"kubernetes.io/projected/0c320497-5e8d-42cd-b617-589aff98aa47-kube-api-access-d5jck\") pod \"authorino-d94db7c54-pfzc4\" (UID: \"0c320497-5e8d-42cd-b617-589aff98aa47\") " pod="kuadrant-system/authorino-d94db7c54-pfzc4" Jun 03 15:51:24.212390 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.212359 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5jck\" (UniqueName: \"kubernetes.io/projected/0c320497-5e8d-42cd-b617-589aff98aa47-kube-api-access-d5jck\") pod \"authorino-d94db7c54-pfzc4\" (UID: \"0c320497-5e8d-42cd-b617-589aff98aa47\") " pod="kuadrant-system/authorino-d94db7c54-pfzc4" Jun 03 15:51:24.304373 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.304279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-tls-cert\") pod \"authorino-7cfbb84bf4-xptwq\" (UID: \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\") " pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:51:24.304373 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.304355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvf68\" (UniqueName: \"kubernetes.io/projected/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-kube-api-access-hvf68\") pod \"authorino-7cfbb84bf4-xptwq\" (UID: \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\") " pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:51:24.404825 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.404778 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvf68\" (UniqueName: \"kubernetes.io/projected/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-kube-api-access-hvf68\") pod \"authorino-7cfbb84bf4-xptwq\" (UID: \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\") " pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:51:24.405057 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.404893 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-tls-cert\") pod \"authorino-7cfbb84bf4-xptwq\" (UID: \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\") " pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:51:24.407386 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.407364 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-tls-cert\") pod \"authorino-7cfbb84bf4-xptwq\" (UID: \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\") " pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:51:24.413841 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.413814 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvf68\" (UniqueName: \"kubernetes.io/projected/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-kube-api-access-hvf68\") pod \"authorino-7cfbb84bf4-xptwq\" (UID: \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\") " pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:51:24.431844 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.431806 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:51:24.568361 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.568267 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cfbb84bf4-xptwq"] Jun 03 15:51:24.571316 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:51:24.571285 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b82770b_504d_4df0_8ae1_6d4a1519eb1b.slice/crio-9b1356786da8b21c54dad12cb66c7919fae3ddc834fcc4588f3c64b19b94bea5 WatchSource:0}: Error finding container 9b1356786da8b21c54dad12cb66c7919fae3ddc834fcc4588f3c64b19b94bea5: Status 404 returned error can't find the container with id 9b1356786da8b21c54dad12cb66c7919fae3ddc834fcc4588f3c64b19b94bea5 Jun 03 15:51:24.726617 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.726582 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" event={"ID":"6b82770b-504d-4df0-8ae1-6d4a1519eb1b","Type":"ContainerStarted","Data":"9b1356786da8b21c54dad12cb66c7919fae3ddc834fcc4588f3c64b19b94bea5"} Jun 03 15:51:24.727050 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.726622 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d94db7c54-pfzc4" Jun 03 15:51:24.727050 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.726622 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-789pb" Jun 03 15:51:24.731954 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.731922 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d94db7c54-pfzc4" Jun 03 15:51:24.735430 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.735412 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-789pb" Jun 03 15:51:24.910367 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.910266 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5jck\" (UniqueName: \"kubernetes.io/projected/0c320497-5e8d-42cd-b617-589aff98aa47-kube-api-access-d5jck\") pod \"0c320497-5e8d-42cd-b617-589aff98aa47\" (UID: \"0c320497-5e8d-42cd-b617-589aff98aa47\") " Jun 03 15:51:24.910520 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.910396 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqp6h\" (UniqueName: \"kubernetes.io/projected/c409113a-1f36-4915-a443-346c37ced09a-kube-api-access-cqp6h\") pod \"c409113a-1f36-4915-a443-346c37ced09a\" (UID: \"c409113a-1f36-4915-a443-346c37ced09a\") " Jun 03 15:51:24.912475 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.912429 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c409113a-1f36-4915-a443-346c37ced09a-kube-api-access-cqp6h" (OuterVolumeSpecName: "kube-api-access-cqp6h") pod "c409113a-1f36-4915-a443-346c37ced09a" (UID: "c409113a-1f36-4915-a443-346c37ced09a"). InnerVolumeSpecName "kube-api-access-cqp6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:51:24.912626 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:24.912528 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c320497-5e8d-42cd-b617-589aff98aa47-kube-api-access-d5jck" (OuterVolumeSpecName: "kube-api-access-d5jck") pod "0c320497-5e8d-42cd-b617-589aff98aa47" (UID: "0c320497-5e8d-42cd-b617-589aff98aa47"). InnerVolumeSpecName "kube-api-access-d5jck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:51:25.011808 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.011779 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqp6h\" (UniqueName: \"kubernetes.io/projected/c409113a-1f36-4915-a443-346c37ced09a-kube-api-access-cqp6h\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:51:25.011808 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.011810 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5jck\" (UniqueName: \"kubernetes.io/projected/0c320497-5e8d-42cd-b617-589aff98aa47-kube-api-access-d5jck\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:51:25.731923 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.731891 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-789pb" Jun 03 15:51:25.731923 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.731894 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" event={"ID":"6b82770b-504d-4df0-8ae1-6d4a1519eb1b","Type":"ContainerStarted","Data":"58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50"} Jun 03 15:51:25.732403 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.732209 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d94db7c54-pfzc4" Jun 03 15:51:25.750142 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.750093 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" podStartSLOduration=1.329923144 podStartE2EDuration="1.750079032s" podCreationTimestamp="2026-06-03 15:51:24 +0000 UTC" firstStartedPulling="2026-06-03 15:51:24.572505602 +0000 UTC m=+636.568804719" lastFinishedPulling="2026-06-03 15:51:24.992661499 +0000 UTC m=+636.988960607" observedRunningTime="2026-06-03 15:51:25.74944315 +0000 UTC m=+637.745742274" watchObservedRunningTime="2026-06-03 15:51:25.750079032 +0000 UTC m=+637.746378153" Jun 03 15:51:25.775784 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.775746 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d94db7c54-pfzc4"] Jun 03 15:51:25.784533 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.784501 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d94db7c54-pfzc4"] Jun 03 15:51:25.828500 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.828463 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-789pb"] Jun 03 15:51:25.842804 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:25.842766 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-789pb"] Jun 03 15:51:26.543580 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:26.543546 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c320497-5e8d-42cd-b617-589aff98aa47" path="/var/lib/kubelet/pods/0c320497-5e8d-42cd-b617-589aff98aa47/volumes" Jun 03 15:51:26.543771 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:51:26.543759 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c409113a-1f36-4915-a443-346c37ced09a" path="/var/lib/kubelet/pods/c409113a-1f36-4915-a443-346c37ced09a/volumes" Jun 03 15:52:55.398318 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:55.398239 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cfbb84bf4-xptwq"] Jun 03 15:52:55.398825 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:55.398493 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" podUID="6b82770b-504d-4df0-8ae1-6d4a1519eb1b" containerName="authorino" containerID="cri-o://58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50" gracePeriod=30 Jun 03 15:52:55.653459 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:55.653383 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:52:55.739219 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:55.739181 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-tls-cert\") pod \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\" (UID: \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\") " Jun 03 15:52:55.739410 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:55.739305 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvf68\" (UniqueName: \"kubernetes.io/projected/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-kube-api-access-hvf68\") pod \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\" (UID: \"6b82770b-504d-4df0-8ae1-6d4a1519eb1b\") " Jun 03 15:52:55.741292 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:55.741252 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-kube-api-access-hvf68" (OuterVolumeSpecName: "kube-api-access-hvf68") pod "6b82770b-504d-4df0-8ae1-6d4a1519eb1b" (UID: "6b82770b-504d-4df0-8ae1-6d4a1519eb1b"). InnerVolumeSpecName "kube-api-access-hvf68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:52:55.749401 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:55.749369 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6b82770b-504d-4df0-8ae1-6d4a1519eb1b" (UID: "6b82770b-504d-4df0-8ae1-6d4a1519eb1b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:55.840085 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:55.840048 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvf68\" (UniqueName: \"kubernetes.io/projected/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-kube-api-access-hvf68\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:52:55.840085 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:55.840079 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b82770b-504d-4df0-8ae1-6d4a1519eb1b-tls-cert\") on node \"ip-10-0-128-175.ec2.internal\" DevicePath \"\"" Jun 03 15:52:56.055430 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.055391 2566 generic.go:358] "Generic (PLEG): container finished" podID="6b82770b-504d-4df0-8ae1-6d4a1519eb1b" containerID="58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50" exitCode=0 Jun 03 15:52:56.055582 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.055451 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" Jun 03 15:52:56.055582 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.055452 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" event={"ID":"6b82770b-504d-4df0-8ae1-6d4a1519eb1b","Type":"ContainerDied","Data":"58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50"} Jun 03 15:52:56.055582 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.055553 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cfbb84bf4-xptwq" event={"ID":"6b82770b-504d-4df0-8ae1-6d4a1519eb1b","Type":"ContainerDied","Data":"9b1356786da8b21c54dad12cb66c7919fae3ddc834fcc4588f3c64b19b94bea5"} Jun 03 15:52:56.055582 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.055570 2566 scope.go:117] "RemoveContainer" containerID="58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50" Jun 03 15:52:56.064093 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.064069 2566 scope.go:117] "RemoveContainer" containerID="58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50" Jun 03 15:52:56.064375 ip-10-0-128-175 kubenswrapper[2566]: E0603 15:52:56.064357 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50\": container with ID starting with 58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50 not found: ID does not exist" containerID="58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50" Jun 03 15:52:56.064418 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.064400 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50"} err="failed to get container status \"58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50\": rpc error: code = NotFound desc = could not find container \"58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50\": container with ID starting with 58c589f5cb14024d4b2296f38a8d456ee673919bff5d7d45aefd00d6bed0ef50 not found: ID does not exist" Jun 03 15:52:56.084534 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.084494 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cfbb84bf4-xptwq"] Jun 03 15:52:56.089119 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.089094 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7cfbb84bf4-xptwq"] Jun 03 15:52:56.543322 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:52:56.543286 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b82770b-504d-4df0-8ae1-6d4a1519eb1b" path="/var/lib/kubelet/pods/6b82770b-504d-4df0-8ae1-6d4a1519eb1b/volumes" Jun 03 15:53:03.786217 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.786181 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p"] Jun 03 15:53:03.787081 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.787057 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b82770b-504d-4df0-8ae1-6d4a1519eb1b" containerName="authorino" Jun 03 15:53:03.787081 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.787081 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b82770b-504d-4df0-8ae1-6d4a1519eb1b" containerName="authorino" Jun 03 15:53:03.787288 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.787270 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b82770b-504d-4df0-8ae1-6d4a1519eb1b" containerName="authorino" Jun 03 15:53:03.791771 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.791744 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:03.795583 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.795552 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 15:53:03.795583 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.795577 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 15:53:03.795783 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.795626 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b7blc\"" Jun 03 15:53:03.795783 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.795654 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 15:53:03.800771 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.800749 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p"] Jun 03 15:53:03.912783 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.912737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b827w\" (UniqueName: \"kubernetes.io/projected/5d4ef880-6f55-4555-8be1-9344280c7f62-kube-api-access-b827w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:03.912995 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.912810 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:03.912995 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.912837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:03.912995 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.912861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d4ef880-6f55-4555-8be1-9344280c7f62-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:03.912995 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.912964 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:03.913139 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:03.913017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.013603 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.013560 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.013807 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.013618 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b827w\" (UniqueName: \"kubernetes.io/projected/5d4ef880-6f55-4555-8be1-9344280c7f62-kube-api-access-b827w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.013807 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.013693 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.013807 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.013725 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.013807 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.013763 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d4ef880-6f55-4555-8be1-9344280c7f62-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.013807 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.013796 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.014183 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.014158 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.014243 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.014170 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.014296 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.014234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.016028 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.016006 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d4ef880-6f55-4555-8be1-9344280c7f62-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.016268 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.016253 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d4ef880-6f55-4555-8be1-9344280c7f62-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.022921 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.022892 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b827w\" (UniqueName: \"kubernetes.io/projected/5d4ef880-6f55-4555-8be1-9344280c7f62-kube-api-access-b827w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p\" (UID: \"5d4ef880-6f55-4555-8be1-9344280c7f62\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.104106 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.103998 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:04.241961 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.241912 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p"] Jun 03 15:53:04.244479 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:53:04.244433 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4ef880_6f55_4555_8be1_9344280c7f62.slice/crio-993171f8686f3c65b5a19149e825a74912a1cd0cfc4b08975d8fa49f5e121f33 WatchSource:0}: Error finding container 993171f8686f3c65b5a19149e825a74912a1cd0cfc4b08975d8fa49f5e121f33: Status 404 returned error can't find the container with id 993171f8686f3c65b5a19149e825a74912a1cd0cfc4b08975d8fa49f5e121f33 Jun 03 15:53:04.246414 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:04.246398 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:53:05.087103 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:05.087066 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" event={"ID":"5d4ef880-6f55-4555-8be1-9344280c7f62","Type":"ContainerStarted","Data":"993171f8686f3c65b5a19149e825a74912a1cd0cfc4b08975d8fa49f5e121f33"} Jun 03 15:53:09.107287 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:09.107245 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" event={"ID":"5d4ef880-6f55-4555-8be1-9344280c7f62","Type":"ContainerStarted","Data":"0199cf1d83778a4b29cfe0468ac54a5685b7bf5aea640e87f58502a16941e7db"} Jun 03 15:53:17.138485 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:17.138449 2566 generic.go:358] "Generic (PLEG): container finished" podID="5d4ef880-6f55-4555-8be1-9344280c7f62" containerID="0199cf1d83778a4b29cfe0468ac54a5685b7bf5aea640e87f58502a16941e7db" exitCode=0 Jun 03 15:53:17.139001 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:17.138498 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" event={"ID":"5d4ef880-6f55-4555-8be1-9344280c7f62","Type":"ContainerDied","Data":"0199cf1d83778a4b29cfe0468ac54a5685b7bf5aea640e87f58502a16941e7db"} Jun 03 15:53:19.147151 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:19.147102 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" event={"ID":"5d4ef880-6f55-4555-8be1-9344280c7f62","Type":"ContainerStarted","Data":"84f68ddc13cfb0b61101dfc36a093f2617c3a1d5e6a0d22cac0b164a69f79038"} Jun 03 15:53:19.171674 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:19.171620 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" podStartSLOduration=1.741241375 podStartE2EDuration="16.171605337s" podCreationTimestamp="2026-06-03 15:53:03 +0000 UTC" firstStartedPulling="2026-06-03 15:53:04.246530447 +0000 UTC m=+736.242829564" lastFinishedPulling="2026-06-03 15:53:18.676894422 +0000 UTC m=+750.673193526" observedRunningTime="2026-06-03 15:53:19.170144437 +0000 UTC m=+751.166443563" watchObservedRunningTime="2026-06-03 15:53:19.171605337 +0000 UTC m=+751.167904464" Jun 03 15:53:24.104551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:24.104507 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:24.104551 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:24.104559 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:24.116728 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:24.116698 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:24.176357 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:24.176318 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p" Jun 03 15:53:34.487467 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.487431 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr"] Jun 03 15:53:34.491284 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.491259 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.493967 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.493946 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 15:53:34.505436 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.505414 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr"] Jun 03 15:53:34.589662 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.589628 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7vlj\" (UniqueName: \"kubernetes.io/projected/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-kube-api-access-m7vlj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.589835 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.589672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.589835 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.589765 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.589835 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.589798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.589835 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.589824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.590039 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.589870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.690861 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.690827 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.691115 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.690906 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7vlj\" (UniqueName: \"kubernetes.io/projected/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-kube-api-access-m7vlj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.691115 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.691059 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.691190 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.691138 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.691190 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.691166 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.691265 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.691204 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.691417 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.691394 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.691516 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.691495 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.691558 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.691538 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.693347 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.693331 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.693690 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.693672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.699101 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.699080 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7vlj\" (UniqueName: \"kubernetes.io/projected/6d688e63-c519-4d4c-a03a-0ae5ee0f13f9-kube-api-access-m7vlj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr\" (UID: \"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.801217 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.801124 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:34.936199 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:34.936161 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr"] Jun 03 15:53:34.939421 ip-10-0-128-175 kubenswrapper[2566]: W0603 15:53:34.939391 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d688e63_c519_4d4c_a03a_0ae5ee0f13f9.slice/crio-b82283e7cf0a9830dda1a1536889c1db2062086b181ed8a8ccafc18d5211a6d0 WatchSource:0}: Error finding container b82283e7cf0a9830dda1a1536889c1db2062086b181ed8a8ccafc18d5211a6d0: Status 404 returned error can't find the container with id b82283e7cf0a9830dda1a1536889c1db2062086b181ed8a8ccafc18d5211a6d0 Jun 03 15:53:35.206971 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:35.206913 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" event={"ID":"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9","Type":"ContainerStarted","Data":"5b13f0151e43eaae41c04c7bc859468c558a4c3b3e175b3ba81d63d114153b31"} Jun 03 15:53:35.206971 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:35.206974 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" event={"ID":"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9","Type":"ContainerStarted","Data":"b82283e7cf0a9830dda1a1536889c1db2062086b181ed8a8ccafc18d5211a6d0"} Jun 03 15:53:39.221043 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:39.221005 2566 generic.go:358] "Generic (PLEG): container finished" podID="6d688e63-c519-4d4c-a03a-0ae5ee0f13f9" containerID="5b13f0151e43eaae41c04c7bc859468c558a4c3b3e175b3ba81d63d114153b31" exitCode=0 Jun 03 15:53:39.221043 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:39.221047 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" event={"ID":"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9","Type":"ContainerDied","Data":"5b13f0151e43eaae41c04c7bc859468c558a4c3b3e175b3ba81d63d114153b31"} Jun 03 15:53:40.226379 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:40.226337 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" event={"ID":"6d688e63-c519-4d4c-a03a-0ae5ee0f13f9","Type":"ContainerStarted","Data":"f1b57225ac6d716b3bdcdcfd98b3c83aa547c6229aadb95de42d3b979b560230"} Jun 03 15:53:40.249884 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:40.249834 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" podStartSLOduration=5.92417315 podStartE2EDuration="6.24981629s" podCreationTimestamp="2026-06-03 15:53:34 +0000 UTC" firstStartedPulling="2026-06-03 15:53:39.221686445 +0000 UTC m=+771.217985549" lastFinishedPulling="2026-06-03 15:53:39.547329579 +0000 UTC m=+771.543628689" observedRunningTime="2026-06-03 15:53:40.2479979 +0000 UTC m=+772.244297024" watchObservedRunningTime="2026-06-03 15:53:40.24981629 +0000 UTC m=+772.246115414" Jun 03 15:53:44.801883 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:44.801824 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:44.801883 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:44.801893 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:44.815088 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:44.815058 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:53:45.256454 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:53:45.256427 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr" Jun 03 15:54:01.174824 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.174787 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z"] Jun 03 15:54:01.201716 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.201683 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z"] Jun 03 15:54:01.201866 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.201808 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.207896 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.207863 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 15:54:01.252160 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.252123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk2h5\" (UniqueName: \"kubernetes.io/projected/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-kube-api-access-qk2h5\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.252160 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.252165 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.252388 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.252185 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.252388 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.252248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.252388 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.252365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.252506 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.252389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.352887 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.352843 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qk2h5\" (UniqueName: \"kubernetes.io/projected/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-kube-api-access-qk2h5\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.352887 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.352892 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.353163 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.352914 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.353163 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.352982 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.353163 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.353143 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.353332 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.353179 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.353428 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.353406 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.353496 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.353461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.353496 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.353484 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.355370 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.355349 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.355611 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.355593 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.364309 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.364280 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk2h5\" (UniqueName: \"kubernetes.io/projected/d3a3b0c9-3007-4627-ac26-3ff459f86ee8-kube-api-access-qk2h5\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z\" (UID: \"d3a3b0c9-3007-4627-ac26-3ff459f86ee8\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.512792 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.512733 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:01.655447 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:01.655423 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z"] Jun 03 15:54:02.309305 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:02.309264 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" event={"ID":"d3a3b0c9-3007-4627-ac26-3ff459f86ee8","Type":"ContainerStarted","Data":"23801bf183a321dc350096e7a0c93e0ee308bdbe8b34a4eaa678ea0b339c3844"} Jun 03 15:54:02.309305 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:02.309308 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" event={"ID":"d3a3b0c9-3007-4627-ac26-3ff459f86ee8","Type":"ContainerStarted","Data":"f7575c3bc35315a419b62766490de58bae5837aa2b3a6af3a57e7a8c38482f4a"} Jun 03 15:54:08.332040 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:08.332001 2566 generic.go:358] "Generic (PLEG): container finished" podID="d3a3b0c9-3007-4627-ac26-3ff459f86ee8" containerID="23801bf183a321dc350096e7a0c93e0ee308bdbe8b34a4eaa678ea0b339c3844" exitCode=0 Jun 03 15:54:08.332491 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:08.332066 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" event={"ID":"d3a3b0c9-3007-4627-ac26-3ff459f86ee8","Type":"ContainerDied","Data":"23801bf183a321dc350096e7a0c93e0ee308bdbe8b34a4eaa678ea0b339c3844"} Jun 03 15:54:09.337003 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:09.336964 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" event={"ID":"d3a3b0c9-3007-4627-ac26-3ff459f86ee8","Type":"ContainerStarted","Data":"94cbe53f742fb83027b8083632e484f3442c4c641fe095465420f4b3e5f59ade"} Jun 03 15:54:09.361726 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:09.361672 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" podStartSLOduration=8.041523271 podStartE2EDuration="8.361655898s" podCreationTimestamp="2026-06-03 15:54:01 +0000 UTC" firstStartedPulling="2026-06-03 15:54:08.332750096 +0000 UTC m=+800.329049202" lastFinishedPulling="2026-06-03 15:54:08.652882711 +0000 UTC m=+800.649181829" observedRunningTime="2026-06-03 15:54:09.359247651 +0000 UTC m=+801.355546778" watchObservedRunningTime="2026-06-03 15:54:09.361655898 +0000 UTC m=+801.357955024" Jun 03 15:54:11.513638 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:11.513599 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:11.514059 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:11.513681 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:11.526072 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:11.526046 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:54:12.359406 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:54:12.359372 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z" Jun 03 15:55:48.490321 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:55:48.490235 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 15:55:48.492032 ip-10-0-128-175 kubenswrapper[2566]: I0603 15:55:48.492007 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 16:00:22.036545 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:22.036509 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548f4487f9-xcpg5_b2bd59ab-2846-47e8-8060-6580af41af79/copy-manifests/0.log" Jun 03 16:00:22.052551 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:22.052524 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548f4487f9-xcpg5_b2bd59ab-2846-47e8-8060-6580af41af79/manager/0.log" Jun 03 16:00:23.626114 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:23.626079 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-fjmck_b911ddd3-23df-44cb-a61b-99e1d7c0190d/manager/0.log" Jun 03 16:00:24.937859 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:24.937827 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cc4c89bc4-jkm5z_3f07efa3-9184-423c-9b18-480a89062b94/kube-auth-proxy/0.log" Jun 03 16:00:25.786318 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:25.786290 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p_5d4ef880-6f55-4555-8be1-9344280c7f62/storage-initializer/0.log" Jun 03 16:00:25.795268 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:25.795243 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-2tc9p_5d4ef880-6f55-4555-8be1-9344280c7f62/main/0.log" Jun 03 16:00:26.032444 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:26.032411 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr_6d688e63-c519-4d4c-a03a-0ae5ee0f13f9/main/0.log" Jun 03 16:00:26.039122 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:26.039055 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-4j7tr_6d688e63-c519-4d4c-a03a-0ae5ee0f13f9/storage-initializer/0.log" Jun 03 16:00:26.273839 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:26.273807 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z_d3a3b0c9-3007-4627-ac26-3ff459f86ee8/storage-initializer/0.log" Jun 03 16:00:26.281483 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:26.281453 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-w5g7z_d3a3b0c9-3007-4627-ac26-3ff459f86ee8/main/0.log" Jun 03 16:00:35.597206 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:35.597153 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4hqsw_6d071120-940c-4ace-8749-8888b43406dc/global-pull-secret-syncer/0.log" Jun 03 16:00:35.806170 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:35.806137 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w8gqh_bd3c1a3c-84a7-47ae-88b6-39e8fc262864/konnectivity-agent/0.log" Jun 03 16:00:35.833878 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:35.833849 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-175.ec2.internal_268f67120e3f2c1264b8612c9914095e/haproxy/0.log" Jun 03 16:00:40.253592 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:40.253492 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-fjmck_b911ddd3-23df-44cb-a61b-99e1d7c0190d/manager/0.log" Jun 03 16:00:42.150252 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.150162 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-znrdv_5842ae88-433c-4c34-8c6e-de0393c9ccdf/cluster-monitoring-operator/0.log" Jun 03 16:00:42.183029 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.182993 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-75g7n_8ab10f7f-20e6-4b70-9cfe-407aca3a6918/kube-state-metrics/0.log" Jun 03 16:00:42.218197 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.218167 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-75g7n_8ab10f7f-20e6-4b70-9cfe-407aca3a6918/kube-rbac-proxy-main/0.log" Jun 03 16:00:42.245971 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.245914 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-75g7n_8ab10f7f-20e6-4b70-9cfe-407aca3a6918/kube-rbac-proxy-self/0.log" Jun 03 16:00:42.275876 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.275849 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8ccd54697-p5h52_85097c10-4cab-4346-9f20-84b24bec2118/metrics-server/0.log" Jun 03 16:00:42.525740 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.525707 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nsnpm_3648816d-eac6-4a3c-9a42-dd8b3e759417/node-exporter/0.log" Jun 03 16:00:42.556064 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.556034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nsnpm_3648816d-eac6-4a3c-9a42-dd8b3e759417/kube-rbac-proxy/0.log" Jun 03 16:00:42.583627 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.583600 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nsnpm_3648816d-eac6-4a3c-9a42-dd8b3e759417/init-textfile/0.log" Jun 03 16:00:42.612538 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.612507 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-g5kw5_ecdb4b5a-2a0a-427f-9282-9d35016592ba/kube-rbac-proxy-main/0.log" Jun 03 16:00:42.639760 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.639734 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-g5kw5_ecdb4b5a-2a0a-427f-9282-9d35016592ba/kube-rbac-proxy-self/0.log" Jun 03 16:00:42.667672 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.667640 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-g5kw5_ecdb4b5a-2a0a-427f-9282-9d35016592ba/openshift-state-metrics/0.log" Jun 03 16:00:42.707482 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.707454 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_799a2133-99bd-4bc7-a172-2a9251261c03/prometheus/0.log" Jun 03 16:00:42.731293 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.731265 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_799a2133-99bd-4bc7-a172-2a9251261c03/config-reloader/0.log" Jun 03 16:00:42.756525 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.756489 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_799a2133-99bd-4bc7-a172-2a9251261c03/thanos-sidecar/0.log" Jun 03 16:00:42.789639 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.789561 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_799a2133-99bd-4bc7-a172-2a9251261c03/kube-rbac-proxy-web/0.log" Jun 03 16:00:42.816433 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.816398 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_799a2133-99bd-4bc7-a172-2a9251261c03/kube-rbac-proxy/0.log" Jun 03 16:00:42.842533 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.842505 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_799a2133-99bd-4bc7-a172-2a9251261c03/kube-rbac-proxy-thanos/0.log" Jun 03 16:00:42.866378 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.866355 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_799a2133-99bd-4bc7-a172-2a9251261c03/init-config-reloader/0.log" Jun 03 16:00:42.896094 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.896068 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-4j6cp_e35c390d-56c3-4e5d-818f-5bc65b5a53ab/prometheus-operator/0.log" Jun 03 16:00:42.917778 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.917745 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-4j6cp_e35c390d-56c3-4e5d-818f-5bc65b5a53ab/kube-rbac-proxy/0.log" Jun 03 16:00:42.955979 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.955951 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-pf2sc_a126e349-6a9c-4a45-8756-3296ce501c8b/prometheus-operator-admission-webhook/0.log" Jun 03 16:00:42.986348 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:42.986317 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bf78b7d77-qqhc7_cebba468-ba2c-4e7c-af20-fada0590ce02/telemeter-client/0.log" Jun 03 16:00:43.009851 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:43.009822 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bf78b7d77-qqhc7_cebba468-ba2c-4e7c-af20-fada0590ce02/reload/0.log" Jun 03 16:00:43.032618 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:43.032591 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bf78b7d77-qqhc7_cebba468-ba2c-4e7c-af20-fada0590ce02/kube-rbac-proxy/0.log" Jun 03 16:00:44.718051 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.718012 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x"] Jun 03 16:00:44.725961 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.725912 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.728846 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.728810 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjb2f\"/\"kube-root-ca.crt\"" Jun 03 16:00:44.729039 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.728908 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjb2f\"/\"openshift-service-ca.crt\"" Jun 03 16:00:44.729039 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.728950 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gjb2f\"/\"default-dockercfg-9mlg5\"" Jun 03 16:00:44.732511 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.732487 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x"] Jun 03 16:00:44.810650 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.810607 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-sys\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.810845 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.810756 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hf2v\" (UniqueName: \"kubernetes.io/projected/3b653127-1770-4f17-aa23-884a5a13d906-kube-api-access-8hf2v\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.810845 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.810793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-proc\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.810845 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.810815 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-lib-modules\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.811058 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.810870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-podres\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.910360 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.910329 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 16:00:44.911439 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.911414 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-sys\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.911589 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.911493 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-sys\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.911589 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.911508 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hf2v\" (UniqueName: \"kubernetes.io/projected/3b653127-1770-4f17-aa23-884a5a13d906-kube-api-access-8hf2v\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.911589 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.911549 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-proc\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.911589 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.911576 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-lib-modules\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.911789 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.911599 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-podres\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.911789 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.911657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-proc\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.911789 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.911737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-podres\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.911789 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.911758 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b653127-1770-4f17-aa23-884a5a13d906-lib-modules\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:44.914807 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.914788 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/2.log" Jun 03 16:00:44.920714 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:44.920693 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hf2v\" (UniqueName: \"kubernetes.io/projected/3b653127-1770-4f17-aa23-884a5a13d906-kube-api-access-8hf2v\") pod \"perf-node-gather-daemonset-ls26x\" (UID: \"3b653127-1770-4f17-aa23-884a5a13d906\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:45.036779 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:45.036685 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:45.173453 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:45.173423 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x"] Jun 03 16:00:45.175999 ip-10-0-128-175 kubenswrapper[2566]: W0603 16:00:45.175964 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3b653127_1770_4f17_aa23_884a5a13d906.slice/crio-f58337d49ca3915a483f6da2d0040ed09a771c7ea243bdca554c8ad8d624ea15 WatchSource:0}: Error finding container f58337d49ca3915a483f6da2d0040ed09a771c7ea243bdca554c8ad8d624ea15: Status 404 returned error can't find the container with id f58337d49ca3915a483f6da2d0040ed09a771c7ea243bdca554c8ad8d624ea15 Jun 03 16:00:45.177739 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:45.177718 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:00:45.799967 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:45.799917 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" event={"ID":"3b653127-1770-4f17-aa23-884a5a13d906","Type":"ContainerStarted","Data":"1bbe8f4fab512098fbe383759b1b4beaf9a6724df87f3b4d5bc0a5f01aabaaa8"} Jun 03 16:00:45.799967 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:45.799967 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" event={"ID":"3b653127-1770-4f17-aa23-884a5a13d906","Type":"ContainerStarted","Data":"f58337d49ca3915a483f6da2d0040ed09a771c7ea243bdca554c8ad8d624ea15"} Jun 03 16:00:45.800424 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:45.800129 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:45.822345 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:45.822290 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" podStartSLOduration=1.822274997 podStartE2EDuration="1.822274997s" podCreationTimestamp="2026-06-03 16:00:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:00:45.820447836 +0000 UTC m=+1197.816746957" watchObservedRunningTime="2026-06-03 16:00:45.822274997 +0000 UTC m=+1197.818574124" Jun 03 16:00:46.895148 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:46.895115 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lqvnf_b4d844ab-840b-4d1c-992a-0b6378488f99/dns/0.log" Jun 03 16:00:46.916481 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:46.916449 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lqvnf_b4d844ab-840b-4d1c-992a-0b6378488f99/kube-rbac-proxy/0.log" Jun 03 16:00:47.071868 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:47.071837 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wpptc_f6caefd0-80ba-43d7-b47c-a7906247a283/dns-node-resolver/0.log" Jun 03 16:00:47.736173 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:47.736134 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sz8cj_e5842307-e08e-42fb-8caa-896c72c2085a/node-ca/0.log" Jun 03 16:00:48.517278 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:48.517248 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 16:00:48.520294 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:48.520270 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-nhfqn_7292a296-6dcd-4b8d-873c-ce85ce1c570d/console-operator/1.log" Jun 03 16:00:48.753639 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:48.753612 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cc4c89bc4-jkm5z_3f07efa3-9184-423c-9b18-480a89062b94/kube-auth-proxy/0.log" Jun 03 16:00:49.509773 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:49.509743 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hkb6b_615a5ed6-3481-43be-bf62-2821574f286b/serve-healthcheck-canary/0.log" Jun 03 16:00:49.971317 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:49.971282 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-54mdl_605527c8-eded-4627-9588-a523bbac42dd/insights-operator/1.log" Jun 03 16:00:49.971705 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:49.971416 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-54mdl_605527c8-eded-4627-9588-a523bbac42dd/insights-operator/0.log" Jun 03 16:00:50.151662 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:50.151637 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-scnr2_9e2b4755-0c5b-4e79-ab6b-b24202ba2bad/kube-rbac-proxy/0.log" Jun 03 16:00:50.174042 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:50.174020 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-scnr2_9e2b4755-0c5b-4e79-ab6b-b24202ba2bad/exporter/0.log" Jun 03 16:00:50.195508 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:50.195475 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-scnr2_9e2b4755-0c5b-4e79-ab6b-b24202ba2bad/extractor/0.log" Jun 03 16:00:51.813152 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:51.813126 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-ls26x" Jun 03 16:00:52.890603 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:52.890572 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548f4487f9-xcpg5_b2bd59ab-2846-47e8-8060-6580af41af79/manager/0.log" Jun 03 16:00:52.913855 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:52.913827 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548f4487f9-xcpg5_b2bd59ab-2846-47e8-8060-6580af41af79/copy-manifests/0.log" Jun 03 16:00:54.315383 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:54.315357 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f96cfff67-2vb8w_b65943bf-1a54-47dc-805a-74730259eef1/manager/0.log" Jun 03 16:00:59.945784 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:59.945745 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-zfmn9_6e0e2194-6372-40c3-b5ce-c36bbf309917/kube-storage-version-migrator-operator/1.log" Jun 03 16:00:59.946496 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:00:59.946479 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-zfmn9_6e0e2194-6372-40c3-b5ce-c36bbf309917/kube-storage-version-migrator-operator/0.log" Jun 03 16:01:01.403235 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.403208 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dscr_6610f372-8966-4d48-a40a-4e0489632b7a/kube-multus-additional-cni-plugins/0.log" Jun 03 16:01:01.428399 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.428373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dscr_6610f372-8966-4d48-a40a-4e0489632b7a/egress-router-binary-copy/0.log" Jun 03 16:01:01.451320 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.451290 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dscr_6610f372-8966-4d48-a40a-4e0489632b7a/cni-plugins/0.log" Jun 03 16:01:01.473853 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.473820 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dscr_6610f372-8966-4d48-a40a-4e0489632b7a/bond-cni-plugin/0.log" Jun 03 16:01:01.497377 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.497349 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dscr_6610f372-8966-4d48-a40a-4e0489632b7a/routeoverride-cni/0.log" Jun 03 16:01:01.520211 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.520184 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dscr_6610f372-8966-4d48-a40a-4e0489632b7a/whereabouts-cni-bincopy/0.log" Jun 03 16:01:01.544201 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.544178 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dscr_6610f372-8966-4d48-a40a-4e0489632b7a/whereabouts-cni/0.log" Jun 03 16:01:01.752249 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.752222 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nv7mm_99e17207-eb70-41e2-b081-32c67efb3585/kube-multus/0.log" Jun 03 16:01:01.860102 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.860074 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r8tzl_ed7e5465-29a7-4ab3-b71f-305d11a1733e/network-metrics-daemon/0.log" Jun 03 16:01:01.884803 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:01.884775 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r8tzl_ed7e5465-29a7-4ab3-b71f-305d11a1733e/kube-rbac-proxy/0.log" Jun 03 16:01:02.808277 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:02.808239 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mdjq_7291d0ca-8a1e-47e1-8edd-e958aa325c17/ovn-controller/0.log" Jun 03 16:01:02.837327 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:02.837282 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mdjq_7291d0ca-8a1e-47e1-8edd-e958aa325c17/ovn-acl-logging/0.log" Jun 03 16:01:02.860677 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:02.860647 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mdjq_7291d0ca-8a1e-47e1-8edd-e958aa325c17/kube-rbac-proxy-node/0.log" Jun 03 16:01:02.887063 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:02.887029 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mdjq_7291d0ca-8a1e-47e1-8edd-e958aa325c17/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 16:01:02.912500 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:02.912469 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mdjq_7291d0ca-8a1e-47e1-8edd-e958aa325c17/northd/0.log" Jun 03 16:01:02.936403 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:02.936374 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mdjq_7291d0ca-8a1e-47e1-8edd-e958aa325c17/nbdb/0.log" Jun 03 16:01:02.965590 ip-10-0-128-175 kubenswrapper[2566]: I0603 16:01:02.965549 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mdjq_7291d0ca-8a1e-47e1-8edd-e958aa325c17/sbdb/0.log"