Jul 09 22:25:58.275742 ip-10-0-136-228 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 22:25:58.275754 ip-10-0-136-228 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 22:25:58.275760 ip-10-0-136-228 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 22:25:58.276063 ip-10-0-136-228 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 22:26:08.475602 ip-10-0-136-228 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 22:26:08.475619 ip-10-0-136-228 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ddbb1790f7c04e9ebec90d44d49d8acc -- Jul 09 22:28:04.584237 ip-10-0-136-228 systemd[1]: Starting Kubernetes Kubelet... Jul 09 22:28:04.947762 ip-10-0-136-228 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 22:28:04.947762 ip-10-0-136-228 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 22:28:04.947762 ip-10-0-136-228 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 22:28:04.947762 ip-10-0-136-228 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 22:28:04.947762 ip-10-0-136-228 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 22:28:04.948771 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.948671 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 22:28:04.956035 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956010 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:28:04.956035 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956033 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:28:04.956035 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956037 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956041 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956045 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956049 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956053 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956056 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956059 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956062 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956065 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956068 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956078 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956082 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956085 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956088 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956091 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956094 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956096 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956099 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956102 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:28:04.956144 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956105 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956108 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956111 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956114 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956116 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956119 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956122 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956124 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956127 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956130 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956132 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956135 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956138 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956141 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956144 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956148 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956151 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956156 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956167 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956170 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:28:04.956658 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956173 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956176 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956179 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956182 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956184 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956187 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956190 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956194 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956198 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956201 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956204 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956207 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956210 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956213 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956216 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956219 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956222 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956225 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956227 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956230 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:28:04.957190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956233 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956237 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956240 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956243 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956246 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956250 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956253 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956258 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956261 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956264 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956268 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956271 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956273 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956276 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956279 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956282 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956284 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956287 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956289 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:28:04.957734 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956292 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956295 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956298 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956301 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956304 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956306 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956309 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956311 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956314 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956317 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956320 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956322 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956325 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956327 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956330 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956333 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956336 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956338 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.956342 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957151 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:28:04.958355 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957159 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957162 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957165 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957168 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957172 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957176 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957179 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957182 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957185 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957188 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957191 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957194 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957197 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957200 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957204 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957207 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957210 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957212 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957215 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957221 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:28:04.958925 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957225 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957228 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957231 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957234 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957237 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957240 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957243 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957246 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957250 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957253 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957256 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957259 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957264 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957267 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957270 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957273 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957275 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957285 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957288 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957291 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:28:04.959490 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957294 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957296 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957299 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957302 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957305 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957308 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957311 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957313 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957316 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957319 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957321 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957324 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957326 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957329 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957332 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957335 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957337 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957340 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957342 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957345 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:28:04.960084 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957348 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957351 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957354 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957356 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957361 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957364 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957366 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957369 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957372 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957374 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957378 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957381 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957383 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957386 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957388 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957391 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957395 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957399 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957402 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957405 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:28:04.960606 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957407 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957411 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957413 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957416 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957418 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957422 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957426 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957430 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957433 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957436 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957439 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957442 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957444 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957447 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957450 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957452 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957455 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957458 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957889 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:28:04.961158 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957894 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957897 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957901 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957904 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957907 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957910 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957913 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957916 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957919 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957921 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957924 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957927 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957930 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957933 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957936 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957939 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957942 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957944 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957947 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957953 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:28:04.961649 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957955 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957958 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957961 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957964 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957967 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957970 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957973 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957975 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957978 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.957982 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958001 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958007 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958011 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958014 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958017 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958020 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958024 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958026 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958030 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:28:04.962181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958032 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958035 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958038 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958041 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958044 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958047 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958050 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958053 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958055 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958059 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958061 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958064 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958070 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958073 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958075 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958079 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958083 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958086 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958089 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:28:04.962681 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958092 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958094 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958098 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958101 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958103 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958106 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958110 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958112 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958115 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958118 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958121 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958124 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958126 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958129 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958132 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958134 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958139 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958142 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958145 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:28:04.963190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958149 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958152 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958155 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958157 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958160 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958163 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958168 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958170 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958173 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958176 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958179 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958182 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958185 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958187 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958190 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958195 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958198 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958201 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958203 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958206 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:28:04.963691 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.958209 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958287 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958296 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958302 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958307 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958313 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958316 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958321 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958326 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958329 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958333 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958336 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958340 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958343 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958346 2567 flags.go:64] FLAG: --cgroup-root="" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958349 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958352 2567 flags.go:64] FLAG: --client-ca-file="" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958356 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958360 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958366 2567 flags.go:64] FLAG: --cluster-domain="" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958369 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958372 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958375 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958379 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 22:28:04.964231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958383 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958386 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958390 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958394 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958397 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958401 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958404 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958408 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958411 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958415 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958418 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958421 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958424 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958428 2567 flags.go:64] FLAG: --enable-server="true" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958431 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958436 2567 flags.go:64] FLAG: --event-burst="100" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958439 2567 flags.go:64] FLAG: --event-qps="50" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958442 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958445 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958448 2567 flags.go:64] FLAG: --eviction-hard="" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958453 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958456 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958459 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958462 2567 flags.go:64] FLAG: --eviction-soft="" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958465 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 22:28:04.964851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958468 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958472 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958475 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958478 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958481 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958484 2567 flags.go:64] FLAG: --feature-gates="" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958488 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958491 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958494 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958497 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958501 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958504 2567 flags.go:64] FLAG: --help="false" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958507 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-136-228.ec2.internal" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958510 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958513 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958516 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958520 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958524 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958527 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958530 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958533 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958535 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958539 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958542 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 22:28:04.965566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958545 2567 flags.go:64] FLAG: --kube-reserved="" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958548 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958551 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958554 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958557 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958560 2567 flags.go:64] FLAG: --lock-file="" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958563 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958566 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958569 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958575 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958579 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958582 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958585 2567 flags.go:64] FLAG: --logging-format="text" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958588 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958591 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958594 2567 flags.go:64] FLAG: --manifest-url="" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958597 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958602 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958605 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958610 2567 flags.go:64] FLAG: --max-pods="110" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958613 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958616 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958619 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958622 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958626 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 22:28:04.966278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958629 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958632 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958640 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958643 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958646 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958650 2567 flags.go:64] FLAG: --pod-cidr="" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958653 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958660 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958663 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958666 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958669 2567 flags.go:64] FLAG: --port="10250" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958672 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958676 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04ddc559aff348d2b" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958679 2567 flags.go:64] FLAG: --qos-reserved="" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958683 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958686 2567 flags.go:64] FLAG: --register-node="true" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958690 2567 flags.go:64] FLAG: --register-with-taints="" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958694 2567 flags.go:64] FLAG: --registry-burst="10" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958697 2567 flags.go:64] FLAG: --registry-qps="5" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958700 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958702 2567 flags.go:64] FLAG: --reserved-memory="" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958712 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958715 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958719 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958722 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 22:28:04.966943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958725 2567 flags.go:64] FLAG: --runonce="false" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958728 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958732 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958735 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958738 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958741 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958744 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958748 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958751 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958754 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958757 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958760 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958763 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958766 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958770 2567 flags.go:64] FLAG: --system-cgroups="" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958773 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958786 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958791 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958796 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958832 2567 flags.go:64] FLAG: --tls-min-version="" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958836 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958839 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958842 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958845 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958848 2567 flags.go:64] FLAG: --v="2" Jul 09 22:28:04.967628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958853 2567 flags.go:64] FLAG: --version="false" Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958857 2567 flags.go:64] FLAG: --vmodule="" Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958861 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.958865 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959035 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959039 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959043 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959048 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959051 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959054 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959057 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959061 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959063 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959067 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959070 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959073 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959076 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959078 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959082 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959084 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:28:04.968319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959087 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959090 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959095 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959098 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959102 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959107 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959110 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959113 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959116 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959118 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959121 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959124 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959126 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959129 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959132 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959134 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959137 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959141 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959145 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:28:04.968936 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959150 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959153 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959156 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959159 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959162 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959165 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959168 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959171 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959174 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959177 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959180 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959184 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959187 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959189 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959192 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959195 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959198 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959201 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959206 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959208 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:28:04.969574 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959211 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959214 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959218 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959222 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959225 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959227 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959230 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959233 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959236 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959239 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959241 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959244 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959249 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959251 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959254 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959257 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959260 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959263 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959267 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:28:04.970174 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959270 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959273 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959276 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959279 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959282 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959285 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959288 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959291 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959294 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959297 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959300 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959304 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959307 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959310 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959313 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959316 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959318 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959321 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959324 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959327 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:28:04.970715 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959329 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959332 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959335 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959337 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.959340 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.960005 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.967629 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.967651 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.967673 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.967679 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967740 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967747 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967751 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967754 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967756 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:28:04.971296 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967759 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967762 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967765 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967768 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967771 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967773 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967776 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967779 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967782 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967785 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967788 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967790 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967793 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967796 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967799 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967802 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967804 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967807 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967810 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967813 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:28:04.971707 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967815 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967818 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967821 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967824 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967829 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967832 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967835 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967837 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967840 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967843 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967845 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967848 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967851 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967854 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967856 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967859 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967861 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967864 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967867 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967869 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:28:04.972262 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967872 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967875 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967877 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967880 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967883 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967885 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967888 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967890 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967895 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967899 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967902 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967905 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967910 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967914 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967917 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967919 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967924 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967927 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967930 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:28:04.972794 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967932 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967935 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967939 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967941 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967944 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967947 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967950 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967953 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967955 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967958 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967961 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967964 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967966 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967969 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967971 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967974 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967977 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967979 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967982 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:28:04.973332 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.967998 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968001 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968004 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968006 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968009 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968012 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968015 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968017 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968020 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968023 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968026 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968030 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968035 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968038 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968041 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:28:04.973828 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968044 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.968050 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968305 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968315 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968319 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968322 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968325 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968334 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968337 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968341 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968344 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968346 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968350 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968353 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:28:04.974319 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.968356 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970148 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970177 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970188 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970195 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970202 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970208 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970213 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970221 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970226 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970232 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970237 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970247 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970250 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970253 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970256 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970259 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970262 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970265 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:28:04.974699 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970269 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970272 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970275 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970278 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970281 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970284 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970290 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970293 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970296 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970299 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970302 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970306 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970309 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970313 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970316 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970319 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970324 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970327 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970331 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970337 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:28:04.975214 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970340 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970343 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970346 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970349 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970352 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970355 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970376 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970401 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970407 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970411 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970415 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970419 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970422 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970426 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970438 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970442 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970458 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970462 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970611 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970620 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:28:04.975738 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970623 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970626 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970629 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970635 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970639 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970643 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970646 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970649 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970652 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970656 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970658 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970662 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970665 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970668 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970671 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970674 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970677 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970681 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970685 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:28:04.976295 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970688 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970691 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970695 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970698 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970701 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970704 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970707 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970709 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:04.970712 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.970719 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.970896 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.974111 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.975409 2567 server.go:1019] "Starting client certificate rotation" Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.975515 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 22:28:04.976809 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.975558 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 22:28:04.978023 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.978007 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 22:28:04.979338 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.979321 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 22:28:04.990840 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.990809 2567 log.go:25] "Validated CRI v1 runtime API" Jul 09 22:28:04.993374 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.993354 2567 log.go:25] "Validated CRI v1 image API" Jul 09 22:28:04.994303 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.994276 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 22:28:04.996757 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.996737 2567 fs.go:135] Filesystem UUIDs: map[11fc95b6-470b-4d87-ab3a-ca6bfb097e94:/dev/nvme0n1p4 2f4506f7-c03f-49ed-b1a3-d489f152ea1f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 09 22:28:04.996810 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:04.996758 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 22:28:05.003028 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.002835 2567 manager.go:216] Machine: {Timestamp:2026-07-09 22:28:05.000687915 +0000 UTC m=+0.298115235 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3084692 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec298291117f84b33bed83e01255f916 SystemUUID:ec298291-117f-84b3-3bed-83e01255f916 BootID:ddbb1790-f7c0-4e9e-bec9-0d44d49d8acc Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:24:3a:b8:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:24:3a:b8:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:9e:9d:bc:10:14 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 22:28:05.003028 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.003007 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 22:28:05.003203 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.003112 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 22:28:05.003734 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.003718 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 22:28:05.005806 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.005778 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 22:28:05.005956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.005808 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 22:28:05.007167 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.007155 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 22:28:05.007204 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.007170 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 22:28:05.007204 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.007179 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 22:28:05.007204 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.007194 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 22:28:05.008711 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.008700 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 22:28:05.012019 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.012003 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 09 22:28:05.012371 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.012358 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 22:28:05.012413 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.012396 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 09 22:28:05.012413 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.012408 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 22:28:05.012489 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.012422 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 22:28:05.012489 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.012433 2567 kubelet.go:398] "Adding apiserver pod source" Jul 09 22:28:05.012489 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.012443 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 22:28:05.012944 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.012924 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 22:28:05.013004 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.012964 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 22:28:05.017487 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.017442 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 22:28:05.019786 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.019770 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 22:28:05.019879 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.019803 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 22:28:05.021369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021356 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 22:28:05.021432 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021373 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 22:28:05.021432 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021380 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 22:28:05.021432 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021386 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 22:28:05.021432 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021395 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 22:28:05.021432 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021401 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 22:28:05.021432 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021409 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 22:28:05.021432 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021416 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 22:28:05.021432 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021427 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 22:28:05.021432 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021435 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 22:28:05.021698 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021445 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 22:28:05.021698 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.021451 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 22:28:05.022211 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.022196 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 22:28:05.022259 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.022211 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 22:28:05.025289 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.025268 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 22:28:05.025383 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.025293 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 22:28:05.025383 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.025305 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 22:28:05.026137 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.026124 2567 server.go:1268] "Started kubelet" Jul 09 22:28:05.026252 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.026205 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 22:28:05.027083 ip-10-0-136-228 systemd[1]: Started Kubernetes Kubelet. Jul 09 22:28:05.027215 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.027072 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 22:28:05.027215 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.027147 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 22:28:05.028458 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.028441 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 09 22:28:05.028667 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.028651 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 22:28:05.031859 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.031813 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 22:28:05.036640 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.035749 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-228.ec2.internal.18c0bf91b88c6edc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-228.ec2.internal,UID:ip-10-0-136-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-228.ec2.internal,},FirstTimestamp:2026-07-09 22:28:05.026090716 +0000 UTC m=+0.323518008,LastTimestamp:2026-07-09 22:28:05.026090716 +0000 UTC m=+0.323518008,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-228.ec2.internal,}" Jul 09 22:28:05.037455 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.037436 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sdkdz" Jul 09 22:28:05.037518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.037485 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 22:28:05.037582 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.037532 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 22:28:05.037638 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.037577 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.038185 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038165 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 22:28:05.038294 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038234 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 22:28:05.038294 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038252 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 22:28:05.038558 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038443 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 09 22:28:05.038558 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038452 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 09 22:28:05.038558 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038497 2567 factory.go:55] Registering systemd factory Jul 09 22:28:05.038558 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038514 2567 factory.go:223] Registration of the systemd container factory successfully Jul 09 22:28:05.038883 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038788 2567 factory.go:153] Registering CRI-O factory Jul 09 22:28:05.038883 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038804 2567 factory.go:223] Registration of the crio container factory successfully Jul 09 22:28:05.038883 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038869 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 22:28:05.039052 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038899 2567 factory.go:103] Registering Raw factory Jul 09 22:28:05.039052 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.038917 2567 manager.go:1196] Started watching for new ooms in manager Jul 09 22:28:05.039483 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.039468 2567 manager.go:349] Starting recovery of all containers Jul 09 22:28:05.041095 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.041065 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 22:28:05.041227 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.041196 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 22:28:05.046639 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.046466 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sdkdz" Jul 09 22:28:05.051609 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.051585 2567 manager.go:354] Recovery completed Jul 09 22:28:05.057528 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.057509 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:28:05.060680 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.060662 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:28:05.060758 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.060699 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:28:05.060758 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.060717 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:28:05.061268 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.061252 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 22:28:05.061268 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.061260 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:28:05.061268 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.061266 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 22:28:05.061428 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.061283 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 09 22:28:05.062053 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.062026 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:28:05.062147 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.062066 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:28:05.062147 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.062080 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:28:05.062325 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.062310 2567 policy_none.go:49] "None policy: Start" Jul 09 22:28:05.062388 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.062331 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 22:28:05.062388 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.062346 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 22:28:05.063254 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.063239 2567 policy_none.go:47] "Start" Jul 09 22:28:05.063751 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.063641 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-228.ec2.internal.18c0bf91ba9c3af1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-228.ec2.internal,UID:ip-10-0-136-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-228.ec2.internal,},FirstTimestamp:2026-07-09 22:28:05.060680433 +0000 UTC m=+0.358107730,LastTimestamp:2026-07-09 22:28:05.060680433 +0000 UTC m=+0.358107730,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-228.ec2.internal,}" Jul 09 22:28:05.109861 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.109835 2567 manager.go:337] "Starting Device Plugin manager" Jul 09 22:28:05.110030 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.109888 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 22:28:05.110030 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.109904 2567 server.go:87] "Starting device plugin registration server" Jul 09 22:28:05.110275 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.110258 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 22:28:05.110350 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.110277 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 22:28:05.110405 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.110372 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 22:28:05.110525 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.110505 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 22:28:05.110604 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.110527 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 22:28:05.111092 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.111054 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 22:28:05.111188 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.111107 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.170685 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.170632 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 22:28:05.171879 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.171859 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 22:28:05.171983 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.171899 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 22:28:05.171983 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.171929 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 22:28:05.171983 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.171966 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 22:28:05.174671 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.174651 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:28:05.211167 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.211067 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:28:05.212200 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.212179 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:28:05.212302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.212214 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:28:05.212302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.212226 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:28:05.212302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.212258 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.221839 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.221821 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.221929 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.221846 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-228.ec2.internal\": node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.244484 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.244455 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.272323 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.272287 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal"] Jul 09 22:28:05.272422 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.272388 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:28:05.273452 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.273422 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:28:05.273556 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.273458 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:28:05.273556 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.273475 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:28:05.274867 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.274851 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:28:05.275004 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.274983 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.275072 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.275023 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:28:05.275652 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.275633 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:28:05.275652 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.275641 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:28:05.275776 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.275668 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:28:05.275776 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.275676 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:28:05.275776 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.275684 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:28:05.275776 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.275688 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:28:05.276828 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.276812 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.276920 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.276847 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:28:05.277477 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.277461 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:28:05.277585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.277490 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:28:05.277585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.277505 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:28:05.298971 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.298921 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-228.ec2.internal\" not found" node="ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.303920 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.303901 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-228.ec2.internal\" not found" node="ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.340301 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.340274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1de034bb34c18d0d39fa5bf9bef22dd8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal\" (UID: \"1de034bb34c18d0d39fa5bf9bef22dd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.340445 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.340309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bb0dda8697e373c519f6dc1fe8e110b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-228.ec2.internal\" (UID: \"9bb0dda8697e373c519f6dc1fe8e110b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.340445 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.340327 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1de034bb34c18d0d39fa5bf9bef22dd8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal\" (UID: \"1de034bb34c18d0d39fa5bf9bef22dd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.345669 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.345641 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.441546 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.441520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1de034bb34c18d0d39fa5bf9bef22dd8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal\" (UID: \"1de034bb34c18d0d39fa5bf9bef22dd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.441678 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.441555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1de034bb34c18d0d39fa5bf9bef22dd8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal\" (UID: \"1de034bb34c18d0d39fa5bf9bef22dd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.441678 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.441575 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bb0dda8697e373c519f6dc1fe8e110b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-228.ec2.internal\" (UID: \"9bb0dda8697e373c519f6dc1fe8e110b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.441678 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.441628 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1de034bb34c18d0d39fa5bf9bef22dd8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal\" (UID: \"1de034bb34c18d0d39fa5bf9bef22dd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.441678 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.441636 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bb0dda8697e373c519f6dc1fe8e110b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-228.ec2.internal\" (UID: \"9bb0dda8697e373c519f6dc1fe8e110b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.441678 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.441643 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1de034bb34c18d0d39fa5bf9bef22dd8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal\" (UID: \"1de034bb34c18d0d39fa5bf9bef22dd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.445887 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.445865 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.546195 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.546093 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.606926 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.606881 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.608079 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.608063 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal" Jul 09 22:28:05.646930 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.646884 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.747325 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.747280 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.847660 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.847577 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.948259 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:05.948217 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:05.974620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.974586 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 22:28:05.974773 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:05.974752 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 22:28:06.048691 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:06.048654 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:06.048691 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.048658 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 22:23:05 +0000 UTC" deadline="2028-02-23 04:49:53.639989125 +0000 UTC" Jul 09 22:28:06.048691 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.048696 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14238h21m47.591297247s" Jul 09 22:28:06.149079 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:06.148996 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:06.170695 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:06.170655 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb0dda8697e373c519f6dc1fe8e110b.slice/crio-076427ecd0bd8585693f4622a5e02153141d16409ccfff79c873f3c0dce181fc WatchSource:0}: Error finding container 076427ecd0bd8585693f4622a5e02153141d16409ccfff79c873f3c0dce181fc: Status 404 returned error can't find the container with id 076427ecd0bd8585693f4622a5e02153141d16409ccfff79c873f3c0dce181fc Jul 09 22:28:06.175345 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.175306 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal" event={"ID":"9bb0dda8697e373c519f6dc1fe8e110b","Type":"ContainerStarted","Data":"076427ecd0bd8585693f4622a5e02153141d16409ccfff79c873f3c0dce181fc"} Jul 09 22:28:06.175345 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.175340 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 22:28:06.202192 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:06.202164 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de034bb34c18d0d39fa5bf9bef22dd8.slice/crio-ecff9f22f163dbfd914904b8cc55c521de779826ca759d903f8b6670d1c18a59 WatchSource:0}: Error finding container ecff9f22f163dbfd914904b8cc55c521de779826ca759d903f8b6670d1c18a59: Status 404 returned error can't find the container with id ecff9f22f163dbfd914904b8cc55c521de779826ca759d903f8b6670d1c18a59 Jul 09 22:28:06.250109 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:06.250070 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:06.351208 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:06.351176 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-228.ec2.internal\" not found" Jul 09 22:28:06.417444 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.417371 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:28:06.438696 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.438665 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal" Jul 09 22:28:06.449005 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.448973 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 22:28:06.450906 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.450888 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" Jul 09 22:28:06.469695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.469666 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 22:28:06.519590 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.519565 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:28:06.619370 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.619342 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:28:06.892779 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:06.892645 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:28:07.013810 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.013776 2567 apiserver.go:52] "Watching apiserver" Jul 09 22:28:07.026695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.026665 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 22:28:07.027150 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.027122 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5","openshift-cluster-node-tuning-operator/tuned-cxdqj","openshift-image-registry/node-ca-ns2b8","openshift-multus/multus-pnfbh","openshift-multus/network-metrics-daemon-l6ts2","openshift-ovn-kubernetes/ovnkube-node-2x4dh","kube-system/global-pull-secret-syncer-nwnhp","kube-system/konnectivity-agent-mr5vv","openshift-dns/node-resolver-p4v6h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal","openshift-multus/multus-additional-cni-plugins-jzpnc","openshift-network-diagnostics/network-check-target-mbrzx","openshift-network-operator/iptables-alerter-l5892","kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal"] Jul 09 22:28:07.028720 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.028697 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.028824 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.028775 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:07.029862 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.029832 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.031066 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.031045 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.032254 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.032237 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.033385 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.033359 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:07.033480 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.033441 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:07.034720 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.034699 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.034832 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.034729 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 22:28:07.035024 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.034980 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-swmmf\"" Jul 09 22:28:07.035115 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.035099 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 22:28:07.035428 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.035397 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 22:28:07.035567 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.035550 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 22:28:07.035681 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.035554 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 22:28:07.035939 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.035904 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 22:28:07.036028 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.035917 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 22:28:07.036089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.035913 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t29ff\"" Jul 09 22:28:07.036089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.036063 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 22:28:07.036306 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.036286 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 22:28:07.036736 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.036718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.038232 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.038213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.038875 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.038853 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 22:28:07.039462 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.039442 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.040803 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.040785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:07.041267 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.041245 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 22:28:07.042293 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.042274 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.043539 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.043518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:07.043667 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.043593 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:07.045225 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.045201 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9tfmq\"" Jul 09 22:28:07.047111 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.047093 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 22:28:07.047209 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.047120 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 22:28:07.048186 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-var-lib-kubelet\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.048283 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048201 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-conf-dir\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.048283 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048227 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-run\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.048283 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62818975-fbda-4d7c-a825-3f5d1732c162-tmp\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.048554 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.048554 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4cb5947-cdf5-48b4-8640-4b8986200ab7-host-slash\") pod \"iptables-alerter-l5892\" (UID: \"c4cb5947-cdf5-48b4-8640-4b8986200ab7\") " pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.048554 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048381 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-run-openvswitch\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.048554 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.048554 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048450 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wsw8\" (UniqueName: \"kubernetes.io/projected/ccdeccaf-ff58-483f-b19f-a647c6d0af7f-kube-api-access-8wsw8\") pod \"node-ca-ns2b8\" (UID: \"ccdeccaf-ff58-483f-b19f-a647c6d0af7f\") " pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.048554 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-daemon-config\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.048554 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-etc-kubernetes\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.048554 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-var-lib-openvswitch\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b335c969-1a70-466e-81a1-20a6309c2545-tmp-dir\") pod \"node-resolver-p4v6h\" (UID: \"b335c969-1a70-466e-81a1-20a6309c2545\") " pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-lib-modules\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-log-socket\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-kubernetes\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-etc-openvswitch\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-run-ovn\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-node-log\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-cni-netd\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccdeccaf-ff58-483f-b19f-a647c6d0af7f-serviceca\") pod \"node-ca-ns2b8\" (UID: \"ccdeccaf-ff58-483f-b19f-a647c6d0af7f\") " pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-system-cni-dir\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-run-k8s-cni-cncf-io\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.048972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-kubelet\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.048974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-run-ovn-kubernetes\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049006 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-sys-fs\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049078 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5zb5\" (UniqueName: \"kubernetes.io/projected/62818975-fbda-4d7c-a825-3f5d1732c162-kube-api-access-p5zb5\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02615a1f-2d64-4642-9b64-a6c2347cc52f-ovnkube-script-lib\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-device-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-sysctl-d\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-var-lib-kubelet\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-var-lib-cni-bin\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049235 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-run-netns\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-cnibin\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02615a1f-2d64-4642-9b64-a6c2347cc52f-ovn-node-metrics-cert\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049355 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdw7v\" (UniqueName: \"kubernetes.io/projected/02615a1f-2d64-4642-9b64-a6c2347cc52f-kube-api-access-gdw7v\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-registration-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chdhh\" (UniqueName: \"kubernetes.io/projected/c251020c-d2b7-4f96-be67-3e6063d48ede-kube-api-access-chdhh\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-systemd\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.049595 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62818975-fbda-4d7c-a825-3f5d1732c162-etc-tuned\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049601 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phhb2\" (UniqueName: \"kubernetes.io/projected/c4cb5947-cdf5-48b4-8640-4b8986200ab7-kube-api-access-phhb2\") pod \"iptables-alerter-l5892\" (UID: \"c4cb5947-cdf5-48b4-8640-4b8986200ab7\") " pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr55q\" (UniqueName: \"kubernetes.io/projected/b335c969-1a70-466e-81a1-20a6309c2545-kube-api-access-mr55q\") pod \"node-resolver-p4v6h\" (UID: \"b335c969-1a70-466e-81a1-20a6309c2545\") " pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctl6v\" (UniqueName: \"kubernetes.io/projected/15eee511-4e3b-4641-971b-de9c85afef15-kube-api-access-ctl6v\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049729 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-cni-binary-copy\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-socket-dir-parent\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-cni-bin\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-socket-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-modprobe-d\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-sysctl-conf\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-host\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-kubelet-config\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-dbus\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.049984 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050005 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02615a1f-2d64-4642-9b64-a6c2347cc52f-env-overrides\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.050369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccdeccaf-ff58-483f-b19f-a647c6d0af7f-host\") pod \"node-ca-ns2b8\" (UID: \"ccdeccaf-ff58-483f-b19f-a647c6d0af7f\") " pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050078 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-hostroot\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzqx\" (UniqueName: \"kubernetes.io/projected/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-kube-api-access-cnzqx\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c4cb5947-cdf5-48b4-8640-4b8986200ab7-iptables-alerter-script\") pod \"iptables-alerter-l5892\" (UID: \"c4cb5947-cdf5-48b4-8640-4b8986200ab7\") " pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-cni-dir\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-run-netns\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-slash\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-run-systemd\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02615a1f-2d64-4642-9b64-a6c2347cc52f-ovnkube-config\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050293 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-var-lib-cni-multus\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050324 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-run-multus-certs\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-systemd-units\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b335c969-1a70-466e-81a1-20a6309c2545-hosts-file\") pod \"node-resolver-p4v6h\" (UID: \"b335c969-1a70-466e-81a1-20a6309c2545\") " pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-sysconfig\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-sys\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.051105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.050494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-os-release\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.058223 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.058193 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5v8bn\"" Jul 09 22:28:07.058356 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.058273 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 22:28:07.058426 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.058199 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 22:28:07.058555 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.058538 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 22:28:07.058621 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.058602 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 22:28:07.058680 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.058624 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 22:28:07.058680 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.058644 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 22:28:07.058680 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.058602 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 22:28:07.059069 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059047 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 22:28:07.059069 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059061 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 22:28:07.059325 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059117 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 22:28:07.059325 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059195 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 22:28:07.059325 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059313 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 22:28:07.059490 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059331 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 22:28:07.059490 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059426 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m9lwv\"" Jul 09 22:28:07.059640 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059623 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n4lbj\"" Jul 09 22:28:07.059640 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059631 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8hld5\"" Jul 09 22:28:07.059752 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.059661 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2wdpx\"" Jul 09 22:28:07.060603 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.060164 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kpvzk\"" Jul 09 22:28:07.089724 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.089483 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 22:28:07.110077 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.110046 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 22:28:07.127099 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.127054 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wvmpj" Jul 09 22:28:07.127473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.127451 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wvmpj" Jul 09 22:28:07.140059 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.140012 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 22:28:07.151257 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151163 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsw8\" (UniqueName: \"kubernetes.io/projected/ccdeccaf-ff58-483f-b19f-a647c6d0af7f-kube-api-access-8wsw8\") pod \"node-ca-ns2b8\" (UID: \"ccdeccaf-ff58-483f-b19f-a647c6d0af7f\") " pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.151257 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151210 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-daemon-config\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.151257 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151238 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-etc-kubernetes\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.151562 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-var-lib-openvswitch\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.151562 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b335c969-1a70-466e-81a1-20a6309c2545-tmp-dir\") pod \"node-resolver-p4v6h\" (UID: \"b335c969-1a70-466e-81a1-20a6309c2545\") " pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.151562 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151316 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-lib-modules\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.151562 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151375 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-var-lib-openvswitch\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.151562 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-system-cni-dir\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.151562 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151469 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-log-socket\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.151562 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151489 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-lib-modules\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.151562 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-kubernetes\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.151562 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1ba1da8-17c5-44da-96e5-dcead667aa5f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151567 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-etc-openvswitch\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151599 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-run-ovn\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-kubernetes\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-node-log\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-log-socket\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151654 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-etc-openvswitch\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-cni-netd\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151717 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccdeccaf-ff58-483f-b19f-a647c6d0af7f-serviceca\") pod \"node-ca-ns2b8\" (UID: \"ccdeccaf-ff58-483f-b19f-a647c6d0af7f\") " pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151787 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-etc-kubernetes\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151823 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-daemon-config\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-system-cni-dir\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151833 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b335c969-1a70-466e-81a1-20a6309c2545-tmp-dir\") pod \"node-resolver-p4v6h\" (UID: \"b335c969-1a70-466e-81a1-20a6309c2545\") " pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-run-k8s-cni-cncf-io\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151919 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-run-ovn\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-system-cni-dir\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-kubelet\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151964 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-node-log\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.151978 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-kubelet\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-run-ovn-kubernetes\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152045 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-cni-netd\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152053 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-run-ovn-kubernetes\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-sys-fs\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152152 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-run-k8s-cni-cncf-io\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152169 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5zb5\" (UniqueName: \"kubernetes.io/projected/62818975-fbda-4d7c-a825-3f5d1732c162-kube-api-access-p5zb5\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152211 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-sys-fs\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0eaea9d0-860a-407a-8473-b2fe449e6220-agent-certs\") pod \"konnectivity-agent-mr5vv\" (UID: \"0eaea9d0-860a-407a-8473-b2fe449e6220\") " pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccdeccaf-ff58-483f-b19f-a647c6d0af7f-serviceca\") pod \"node-ca-ns2b8\" (UID: \"ccdeccaf-ff58-483f-b19f-a647c6d0af7f\") " pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02615a1f-2d64-4642-9b64-a6c2347cc52f-ovnkube-script-lib\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152284 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-device-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-sysctl-d\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152443 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-device-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152479 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-var-lib-kubelet\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1ba1da8-17c5-44da-96e5-dcead667aa5f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152537 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-sysctl-d\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.152969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152573 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-var-lib-kubelet\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152614 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-var-lib-cni-bin\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-run-netns\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152667 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-var-lib-cni-bin\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7blv\" (UniqueName: \"kubernetes.io/projected/a1ba1da8-17c5-44da-96e5-dcead667aa5f-kube-api-access-c7blv\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152702 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-cnibin\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152714 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-run-netns\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02615a1f-2d64-4642-9b64-a6c2347cc52f-ovn-node-metrics-cert\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdw7v\" (UniqueName: \"kubernetes.io/projected/02615a1f-2d64-4642-9b64-a6c2347cc52f-kube-api-access-gdw7v\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152765 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-cnibin\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-registration-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152788 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02615a1f-2d64-4642-9b64-a6c2347cc52f-ovnkube-script-lib\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chdhh\" (UniqueName: \"kubernetes.io/projected/c251020c-d2b7-4f96-be67-3e6063d48ede-kube-api-access-chdhh\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-systemd\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0eaea9d0-860a-407a-8473-b2fe449e6220-konnectivity-ca\") pod \"konnectivity-agent-mr5vv\" (UID: \"0eaea9d0-860a-407a-8473-b2fe449e6220\") " pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.152930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62818975-fbda-4d7c-a825-3f5d1732c162-etc-tuned\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.153897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153006 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-registration-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-cnibin\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phhb2\" (UniqueName: \"kubernetes.io/projected/c4cb5947-cdf5-48b4-8640-4b8986200ab7-kube-api-access-phhb2\") pod \"iptables-alerter-l5892\" (UID: \"c4cb5947-cdf5-48b4-8640-4b8986200ab7\") " pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr55q\" (UniqueName: \"kubernetes.io/projected/b335c969-1a70-466e-81a1-20a6309c2545-kube-api-access-mr55q\") pod \"node-resolver-p4v6h\" (UID: \"b335c969-1a70-466e-81a1-20a6309c2545\") " pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153128 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153142 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-systemd\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-os-release\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl6v\" (UniqueName: \"kubernetes.io/projected/15eee511-4e3b-4641-971b-de9c85afef15-kube-api-access-ctl6v\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.153219 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153235 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-cni-binary-copy\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-socket-dir-parent\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153281 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-cni-bin\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.153319 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs podName:15eee511-4e3b-4641-971b-de9c85afef15 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:07.653276801 +0000 UTC m=+2.950704091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs") pod "network-metrics-daemon-l6ts2" (UID: "15eee511-4e3b-4641-971b-de9c85afef15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153324 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-cni-bin\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-socket-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-modprobe-d\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.154706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-sysctl-conf\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-host\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-kubelet-config\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153484 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-socket-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153523 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-kubelet-config\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153523 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-modprobe-d\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153381 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-socket-dir-parent\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-dbus\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153584 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-host\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-sysctl-conf\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02615a1f-2d64-4642-9b64-a6c2347cc52f-env-overrides\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153636 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccdeccaf-ff58-483f-b19f-a647c6d0af7f-host\") pod \"node-ca-ns2b8\" (UID: \"ccdeccaf-ff58-483f-b19f-a647c6d0af7f\") " pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-hostroot\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzqx\" (UniqueName: \"kubernetes.io/projected/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-kube-api-access-cnzqx\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153708 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-dbus\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153764 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccdeccaf-ff58-483f-b19f-a647c6d0af7f-host\") pod \"node-ca-ns2b8\" (UID: \"ccdeccaf-ff58-483f-b19f-a647c6d0af7f\") " pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153765 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c4cb5947-cdf5-48b4-8640-4b8986200ab7-iptables-alerter-script\") pod \"iptables-alerter-l5892\" (UID: \"c4cb5947-cdf5-48b4-8640-4b8986200ab7\") " pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.155505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153800 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-cni-dir\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-cni-dir\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153856 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-cni-binary-copy\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-run-netns\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-run-netns\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153889 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-hostroot\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-slash\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-run-systemd\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02615a1f-2d64-4642-9b64-a6c2347cc52f-ovnkube-config\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-run-systemd\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.153946 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-slash\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1ba1da8-17c5-44da-96e5-dcead667aa5f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-var-lib-cni-multus\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02615a1f-2d64-4642-9b64-a6c2347cc52f-env-overrides\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154083 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-run-multus-certs\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-systemd-units\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-var-lib-cni-multus\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.156302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154157 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-run-multus-certs\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b335c969-1a70-466e-81a1-20a6309c2545-hosts-file\") pod \"node-resolver-p4v6h\" (UID: \"b335c969-1a70-466e-81a1-20a6309c2545\") " pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-sysconfig\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-sys\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154303 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-systemd-units\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154338 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c4cb5947-cdf5-48b4-8640-4b8986200ab7-iptables-alerter-script\") pod \"iptables-alerter-l5892\" (UID: \"c4cb5947-cdf5-48b4-8640-4b8986200ab7\") " pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-etc-sysconfig\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-os-release\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-sys\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154395 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-var-lib-kubelet\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b335c969-1a70-466e-81a1-20a6309c2545-hosts-file\") pod \"node-resolver-p4v6h\" (UID: \"b335c969-1a70-466e-81a1-20a6309c2545\") " pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154424 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-conf-dir\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154448 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-os-release\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-run\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154456 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-host-var-lib-kubelet\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.157129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154481 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02615a1f-2d64-4642-9b64-a6c2347cc52f-ovnkube-config\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154496 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-multus-conf-dir\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62818975-fbda-4d7c-a825-3f5d1732c162-tmp\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154513 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62818975-fbda-4d7c-a825-3f5d1732c162-run\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154531 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4cb5947-cdf5-48b4-8640-4b8986200ab7-host-slash\") pod \"iptables-alerter-l5892\" (UID: \"c4cb5947-cdf5-48b4-8640-4b8986200ab7\") " pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154588 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-run-openvswitch\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4cb5947-cdf5-48b4-8640-4b8986200ab7-host-slash\") pod \"iptables-alerter-l5892\" (UID: \"c4cb5947-cdf5-48b4-8640-4b8986200ab7\") " pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.154664 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154696 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02615a1f-2d64-4642-9b64-a6c2347cc52f-run-openvswitch\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.154703 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c251020c-d2b7-4f96-be67-3e6063d48ede-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.158126 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.154734 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret podName:e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:07.654716618 +0000 UTC m=+2.952143911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret") pod "global-pull-secret-syncer-nwnhp" (UID: "e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:07.158751 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.158406 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62818975-fbda-4d7c-a825-3f5d1732c162-etc-tuned\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.158751 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.158551 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02615a1f-2d64-4642-9b64-a6c2347cc52f-ovn-node-metrics-cert\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.159541 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.159516 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62818975-fbda-4d7c-a825-3f5d1732c162-tmp\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.177874 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.177795 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" event={"ID":"1de034bb34c18d0d39fa5bf9bef22dd8","Type":"ContainerStarted","Data":"ecff9f22f163dbfd914904b8cc55c521de779826ca759d903f8b6670d1c18a59"} Jul 09 22:28:07.190270 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.190238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdw7v\" (UniqueName: \"kubernetes.io/projected/02615a1f-2d64-4642-9b64-a6c2347cc52f-kube-api-access-gdw7v\") pod \"ovnkube-node-2x4dh\" (UID: \"02615a1f-2d64-4642-9b64-a6c2347cc52f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.190937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.190910 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5zb5\" (UniqueName: \"kubernetes.io/projected/62818975-fbda-4d7c-a825-3f5d1732c162-kube-api-access-p5zb5\") pod \"tuned-cxdqj\" (UID: \"62818975-fbda-4d7c-a825-3f5d1732c162\") " pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.191930 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.191891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phhb2\" (UniqueName: \"kubernetes.io/projected/c4cb5947-cdf5-48b4-8640-4b8986200ab7-kube-api-access-phhb2\") pod \"iptables-alerter-l5892\" (UID: \"c4cb5947-cdf5-48b4-8640-4b8986200ab7\") " pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.194469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.194359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzqx\" (UniqueName: \"kubernetes.io/projected/1b67bf4b-07c2-42b6-b12b-7b53148f3f43-kube-api-access-cnzqx\") pod \"multus-pnfbh\" (UID: \"1b67bf4b-07c2-42b6-b12b-7b53148f3f43\") " pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.196947 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.196768 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr55q\" (UniqueName: \"kubernetes.io/projected/b335c969-1a70-466e-81a1-20a6309c2545-kube-api-access-mr55q\") pod \"node-resolver-p4v6h\" (UID: \"b335c969-1a70-466e-81a1-20a6309c2545\") " pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.197311 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.197281 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctl6v\" (UniqueName: \"kubernetes.io/projected/15eee511-4e3b-4641-971b-de9c85afef15-kube-api-access-ctl6v\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:07.197511 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.197474 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chdhh\" (UniqueName: \"kubernetes.io/projected/c251020c-d2b7-4f96-be67-3e6063d48ede-kube-api-access-chdhh\") pod \"aws-ebs-csi-driver-node-jgnm5\" (UID: \"c251020c-d2b7-4f96-be67-3e6063d48ede\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.197870 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.197849 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wsw8\" (UniqueName: \"kubernetes.io/projected/ccdeccaf-ff58-483f-b19f-a647c6d0af7f-kube-api-access-8wsw8\") pod \"node-ca-ns2b8\" (UID: \"ccdeccaf-ff58-483f-b19f-a647c6d0af7f\") " pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.256083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256044 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-system-cni-dir\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1ba1da8-17c5-44da-96e5-dcead667aa5f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256345 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0eaea9d0-860a-407a-8473-b2fe449e6220-agent-certs\") pod \"konnectivity-agent-mr5vv\" (UID: \"0eaea9d0-860a-407a-8473-b2fe449e6220\") " pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:07.256345 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256162 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-system-cni-dir\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256345 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1ba1da8-17c5-44da-96e5-dcead667aa5f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256345 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256335 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7blv\" (UniqueName: \"kubernetes.io/projected/a1ba1da8-17c5-44da-96e5-dcead667aa5f-kube-api-access-c7blv\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256608 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0eaea9d0-860a-407a-8473-b2fe449e6220-konnectivity-ca\") pod \"konnectivity-agent-mr5vv\" (UID: \"0eaea9d0-860a-407a-8473-b2fe449e6220\") " pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:07.256608 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256429 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-cnibin\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256608 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:07.256608 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-os-release\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256608 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1ba1da8-17c5-44da-96e5-dcead667aa5f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256608 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-cnibin\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256608 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256953 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256752 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-os-release\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256953 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256765 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1ba1da8-17c5-44da-96e5-dcead667aa5f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256953 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1ba1da8-17c5-44da-96e5-dcead667aa5f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.256953 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.256821 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1ba1da8-17c5-44da-96e5-dcead667aa5f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.257320 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.257299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0eaea9d0-860a-407a-8473-b2fe449e6220-konnectivity-ca\") pod \"konnectivity-agent-mr5vv\" (UID: \"0eaea9d0-860a-407a-8473-b2fe449e6220\") " pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:07.257403 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.257386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1ba1da8-17c5-44da-96e5-dcead667aa5f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.259217 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.259197 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0eaea9d0-860a-407a-8473-b2fe449e6220-agent-certs\") pod \"konnectivity-agent-mr5vv\" (UID: \"0eaea9d0-860a-407a-8473-b2fe449e6220\") " pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:07.264498 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.264478 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:07.264498 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.264502 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:07.264670 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.264517 2567 projected.go:196] Error preparing data for projected volume kube-api-access-t5tc6 for pod openshift-network-diagnostics/network-check-target-mbrzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:07.264670 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.264586 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6 podName:5e870bc9-d72c-4db6-a649-5ab17939ae45 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:07.764568202 +0000 UTC m=+3.061995720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t5tc6" (UniqueName: "kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6") pod "network-check-target-mbrzx" (UID: "5e870bc9-d72c-4db6-a649-5ab17939ae45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:07.267007 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.266983 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7blv\" (UniqueName: \"kubernetes.io/projected/a1ba1da8-17c5-44da-96e5-dcead667aa5f-kube-api-access-c7blv\") pod \"multus-additional-cni-plugins-jzpnc\" (UID: \"a1ba1da8-17c5-44da-96e5-dcead667aa5f\") " pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.344053 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.343982 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5892" Jul 09 22:28:07.351850 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.351821 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ns2b8" Jul 09 22:28:07.363248 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.363215 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pnfbh" Jul 09 22:28:07.376903 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.376869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:07.385863 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.385841 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4v6h" Jul 09 22:28:07.393718 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.393693 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" Jul 09 22:28:07.403450 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.403377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" Jul 09 22:28:07.411902 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.411875 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:07.419641 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.419619 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" Jul 09 22:28:07.660797 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.660701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:07.660985 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.660806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:07.660985 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.660865 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:07.660985 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.660954 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs podName:15eee511-4e3b-4641-971b-de9c85afef15 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:08.660935549 +0000 UTC m=+3.958362842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs") pod "network-metrics-daemon-l6ts2" (UID: "15eee511-4e3b-4641-971b-de9c85afef15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:07.660985 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.660979 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:07.661173 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.661044 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret podName:e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:08.661029821 +0000 UTC m=+3.958457120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret") pod "global-pull-secret-syncer-nwnhp" (UID: "e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:07.863376 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:07.862806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:07.863376 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.863034 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:07.863376 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.863057 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:07.863376 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.863072 2567 projected.go:196] Error preparing data for projected volume kube-api-access-t5tc6 for pod openshift-network-diagnostics/network-check-target-mbrzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:07.863376 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:07.863143 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6 podName:5e870bc9-d72c-4db6-a649-5ab17939ae45 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:08.86312401 +0000 UTC m=+4.160551288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5tc6" (UniqueName: "kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6") pod "network-check-target-mbrzx" (UID: "5e870bc9-d72c-4db6-a649-5ab17939ae45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:08.130298 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:08.130198 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:23:07 +0000 UTC" deadline="2027-12-06 09:03:34.51396146 +0000 UTC" Jul 09 22:28:08.130298 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:08.130238 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12346h35m26.383728743s" Jul 09 22:28:08.363528 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:08.363413 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62818975_fbda_4d7c_a825_3f5d1732c162.slice/crio-f3215748bf724f12331fd3a26f72dfd559933406ebdc1c778bb43f983de69153 WatchSource:0}: Error finding container f3215748bf724f12331fd3a26f72dfd559933406ebdc1c778bb43f983de69153: Status 404 returned error can't find the container with id f3215748bf724f12331fd3a26f72dfd559933406ebdc1c778bb43f983de69153 Jul 09 22:28:08.367784 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:08.367756 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb335c969_1a70_466e_81a1_20a6309c2545.slice/crio-baf0fb4ada86e5c40076ff160dc0536deae13bdbb0936a9e0f577e58112c2dab WatchSource:0}: Error finding container baf0fb4ada86e5c40076ff160dc0536deae13bdbb0936a9e0f577e58112c2dab: Status 404 returned error can't find the container with id baf0fb4ada86e5c40076ff160dc0536deae13bdbb0936a9e0f577e58112c2dab Jul 09 22:28:08.372507 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:08.372485 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ba1da8_17c5_44da_96e5_dcead667aa5f.slice/crio-55ce77eac1995d89ee19d93725acb73930e6531b3ec3f12ad2b3a827d18b0bc4 WatchSource:0}: Error finding container 55ce77eac1995d89ee19d93725acb73930e6531b3ec3f12ad2b3a827d18b0bc4: Status 404 returned error can't find the container with id 55ce77eac1995d89ee19d93725acb73930e6531b3ec3f12ad2b3a827d18b0bc4 Jul 09 22:28:08.373547 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:08.373526 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eaea9d0_860a_407a_8473_b2fe449e6220.slice/crio-e9b3de5655257ca1f7770501bac23626661002d3a7315397b982c659a556de5e WatchSource:0}: Error finding container e9b3de5655257ca1f7770501bac23626661002d3a7315397b982c659a556de5e: Status 404 returned error can't find the container with id e9b3de5655257ca1f7770501bac23626661002d3a7315397b982c659a556de5e Jul 09 22:28:08.375181 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:08.375069 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02615a1f_2d64_4642_9b64_a6c2347cc52f.slice/crio-5f3e7b061681be4dbd328e66df5da0c3467587ba3f5c62971d0902c2ed2bc12e WatchSource:0}: Error finding container 5f3e7b061681be4dbd328e66df5da0c3467587ba3f5c62971d0902c2ed2bc12e: Status 404 returned error can't find the container with id 5f3e7b061681be4dbd328e66df5da0c3467587ba3f5c62971d0902c2ed2bc12e Jul 09 22:28:08.376795 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:08.376775 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b67bf4b_07c2_42b6_b12b_7b53148f3f43.slice/crio-70ca3a7ab3932b85b37b331ffd663ea0d1dab65cce12694dd6ea9ea0ca44759a WatchSource:0}: Error finding container 70ca3a7ab3932b85b37b331ffd663ea0d1dab65cce12694dd6ea9ea0ca44759a: Status 404 returned error can't find the container with id 70ca3a7ab3932b85b37b331ffd663ea0d1dab65cce12694dd6ea9ea0ca44759a Jul 09 22:28:08.378016 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:08.377975 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc251020c_d2b7_4f96_be67_3e6063d48ede.slice/crio-4b24626e2a1d4f203ec41248b7d2a97f0d9870ca3883a5628666c6adab955386 WatchSource:0}: Error finding container 4b24626e2a1d4f203ec41248b7d2a97f0d9870ca3883a5628666c6adab955386: Status 404 returned error can't find the container with id 4b24626e2a1d4f203ec41248b7d2a97f0d9870ca3883a5628666c6adab955386 Jul 09 22:28:08.380765 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:08.380745 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4cb5947_cdf5_48b4_8640_4b8986200ab7.slice/crio-3dd2de29374fe6c8626ce59b90a78f0a9e35d802455471b79d76140d14c137c6 WatchSource:0}: Error finding container 3dd2de29374fe6c8626ce59b90a78f0a9e35d802455471b79d76140d14c137c6: Status 404 returned error can't find the container with id 3dd2de29374fe6c8626ce59b90a78f0a9e35d802455471b79d76140d14c137c6 Jul 09 22:28:08.382619 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:28:08.382531 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdeccaf_ff58_483f_b19f_a647c6d0af7f.slice/crio-33aa6662908ff6963cc79c400973449af47fbb7d2c8e3c00802cdc42194f853b WatchSource:0}: Error finding container 33aa6662908ff6963cc79c400973449af47fbb7d2c8e3c00802cdc42194f853b: Status 404 returned error can't find the container with id 33aa6662908ff6963cc79c400973449af47fbb7d2c8e3c00802cdc42194f853b Jul 09 22:28:08.670916 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:08.670737 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:08.671063 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:08.670958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:08.671063 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:08.670890 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:08.671155 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:08.671069 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs podName:15eee511-4e3b-4641-971b-de9c85afef15 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:10.671049249 +0000 UTC m=+5.968476531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs") pod "network-metrics-daemon-l6ts2" (UID: "15eee511-4e3b-4641-971b-de9c85afef15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:08.671155 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:08.671070 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:08.671155 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:08.671129 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret podName:e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:10.671114436 +0000 UTC m=+5.968541713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret") pod "global-pull-secret-syncer-nwnhp" (UID: "e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:08.873655 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:08.873600 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:08.873837 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:08.873786 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:08.873837 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:08.873811 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:08.873837 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:08.873821 2567 projected.go:196] Error preparing data for projected volume kube-api-access-t5tc6 for pod openshift-network-diagnostics/network-check-target-mbrzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:08.873958 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:08.873880 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6 podName:5e870bc9-d72c-4db6-a649-5ab17939ae45 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:10.873860933 +0000 UTC m=+6.171288217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5tc6" (UniqueName: "kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6") pod "network-check-target-mbrzx" (UID: "5e870bc9-d72c-4db6-a649-5ab17939ae45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:09.130525 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.130442 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:23:07 +0000 UTC" deadline="2027-12-28 22:20:26.359688453 +0000 UTC" Jul 09 22:28:09.130525 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.130516 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12887h52m17.229177883s" Jul 09 22:28:09.173108 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.172511 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:09.173108 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:09.172656 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:09.173108 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.172881 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:09.173108 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:09.172995 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:09.173468 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.173204 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:09.173468 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:09.173304 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:09.191862 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.191819 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal" event={"ID":"9bb0dda8697e373c519f6dc1fe8e110b","Type":"ContainerStarted","Data":"a86dd30e951353e9053bfadae49292a4b66cd250f0400057d0b678b1e05c6cf6"} Jul 09 22:28:09.205187 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.205149 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ns2b8" event={"ID":"ccdeccaf-ff58-483f-b19f-a647c6d0af7f","Type":"ContainerStarted","Data":"33aa6662908ff6963cc79c400973449af47fbb7d2c8e3c00802cdc42194f853b"} Jul 09 22:28:09.212271 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.212233 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pnfbh" event={"ID":"1b67bf4b-07c2-42b6-b12b-7b53148f3f43","Type":"ContainerStarted","Data":"70ca3a7ab3932b85b37b331ffd663ea0d1dab65cce12694dd6ea9ea0ca44759a"} Jul 09 22:28:09.216616 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.216586 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" event={"ID":"62818975-fbda-4d7c-a825-3f5d1732c162","Type":"ContainerStarted","Data":"f3215748bf724f12331fd3a26f72dfd559933406ebdc1c778bb43f983de69153"} Jul 09 22:28:09.228688 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.228627 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-228.ec2.internal" podStartSLOduration=3.228606446 podStartE2EDuration="3.228606446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:09.228098354 +0000 UTC m=+4.525525658" watchObservedRunningTime="2026-07-09 22:28:09.228606446 +0000 UTC m=+4.526033749" Jul 09 22:28:09.234401 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.233733 2567 generic.go:356] "Generic (PLEG): container finished" podID="1de034bb34c18d0d39fa5bf9bef22dd8" containerID="1061940ca6f153235924dcd7ae25e431b1879e630ba981933daac71668f82e81" exitCode=0 Jul 09 22:28:09.234401 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.234050 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" event={"ID":"1de034bb34c18d0d39fa5bf9bef22dd8","Type":"ContainerDied","Data":"1061940ca6f153235924dcd7ae25e431b1879e630ba981933daac71668f82e81"} Jul 09 22:28:09.242717 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.242645 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5892" event={"ID":"c4cb5947-cdf5-48b4-8640-4b8986200ab7","Type":"ContainerStarted","Data":"3dd2de29374fe6c8626ce59b90a78f0a9e35d802455471b79d76140d14c137c6"} Jul 09 22:28:09.246057 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.245953 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" event={"ID":"c251020c-d2b7-4f96-be67-3e6063d48ede","Type":"ContainerStarted","Data":"4b24626e2a1d4f203ec41248b7d2a97f0d9870ca3883a5628666c6adab955386"} Jul 09 22:28:09.255856 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.255637 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" event={"ID":"02615a1f-2d64-4642-9b64-a6c2347cc52f","Type":"ContainerStarted","Data":"5f3e7b061681be4dbd328e66df5da0c3467587ba3f5c62971d0902c2ed2bc12e"} Jul 09 22:28:09.282758 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.282719 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" event={"ID":"a1ba1da8-17c5-44da-96e5-dcead667aa5f","Type":"ContainerStarted","Data":"55ce77eac1995d89ee19d93725acb73930e6531b3ec3f12ad2b3a827d18b0bc4"} Jul 09 22:28:09.296383 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.296342 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mr5vv" event={"ID":"0eaea9d0-860a-407a-8473-b2fe449e6220","Type":"ContainerStarted","Data":"e9b3de5655257ca1f7770501bac23626661002d3a7315397b982c659a556de5e"} Jul 09 22:28:09.317459 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:09.317419 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4v6h" event={"ID":"b335c969-1a70-466e-81a1-20a6309c2545","Type":"ContainerStarted","Data":"baf0fb4ada86e5c40076ff160dc0536deae13bdbb0936a9e0f577e58112c2dab"} Jul 09 22:28:10.348727 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:10.348688 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" event={"ID":"1de034bb34c18d0d39fa5bf9bef22dd8","Type":"ContainerStarted","Data":"953d0c789ff08043345884fdc3db5e178c6d5dc5fe2cb9b19359695cdec410c2"} Jul 09 22:28:10.688589 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:10.688491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:10.688589 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:10.688577 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:10.688830 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:10.688724 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:10.688830 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:10.688793 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs podName:15eee511-4e3b-4641-971b-de9c85afef15 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:14.688771251 +0000 UTC m=+9.986198528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs") pod "network-metrics-daemon-l6ts2" (UID: "15eee511-4e3b-4641-971b-de9c85afef15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:10.689263 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:10.689241 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:10.689386 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:10.689304 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret podName:e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:14.689285358 +0000 UTC m=+9.986712640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret") pod "global-pull-secret-syncer-nwnhp" (UID: "e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:10.890644 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:10.890599 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:10.890828 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:10.890789 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:10.890828 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:10.890812 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:10.890828 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:10.890826 2567 projected.go:196] Error preparing data for projected volume kube-api-access-t5tc6 for pod openshift-network-diagnostics/network-check-target-mbrzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:10.891023 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:10.890889 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6 podName:5e870bc9-d72c-4db6-a649-5ab17939ae45 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:14.890869101 +0000 UTC m=+10.188296637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5tc6" (UniqueName: "kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6") pod "network-check-target-mbrzx" (UID: "5e870bc9-d72c-4db6-a649-5ab17939ae45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:11.175505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:11.175336 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:11.175505 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:11.175484 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:11.175766 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:11.175558 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:11.175766 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:11.175641 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:11.175766 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:11.175680 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:11.175766 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:11.175750 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:13.174528 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:13.174495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:13.174978 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:13.174629 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:13.175135 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:13.175116 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:13.175208 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:13.175116 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:13.175260 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:13.175232 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:13.175319 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:13.175276 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:14.722203 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:14.722153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:14.722684 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:14.722247 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:14.722684 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:14.722396 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:14.722684 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:14.722495 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs podName:15eee511-4e3b-4641-971b-de9c85afef15 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:22.72245193 +0000 UTC m=+18.019879227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs") pod "network-metrics-daemon-l6ts2" (UID: "15eee511-4e3b-4641-971b-de9c85afef15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:14.722684 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:14.722396 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:14.722684 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:14.722557 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret podName:e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:22.722542698 +0000 UTC m=+18.019969984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret") pod "global-pull-secret-syncer-nwnhp" (UID: "e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:14.923984 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:14.923950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:14.924140 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:14.924107 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:14.924140 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:14.924125 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:14.924140 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:14.924135 2567 projected.go:196] Error preparing data for projected volume kube-api-access-t5tc6 for pod openshift-network-diagnostics/network-check-target-mbrzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:14.924247 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:14.924193 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6 podName:5e870bc9-d72c-4db6-a649-5ab17939ae45 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:22.924177821 +0000 UTC m=+18.221605099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5tc6" (UniqueName: "kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6") pod "network-check-target-mbrzx" (UID: "5e870bc9-d72c-4db6-a649-5ab17939ae45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:15.173649 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:15.173506 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:15.173649 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:15.173638 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:15.174161 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:15.173939 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:15.174161 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:15.174045 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:15.174161 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:15.174086 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:15.174161 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:15.174125 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:17.173631 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:17.173060 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:17.173631 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:17.173246 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:17.173631 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:17.173376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:17.173631 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:17.173455 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:17.173631 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:17.173509 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:17.173631 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:17.173582 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:19.172906 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:19.172874 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:19.173451 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:19.173022 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:19.173451 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:19.173036 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:19.173451 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:19.173199 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:19.173451 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:19.173209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:19.173451 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:19.173299 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:21.172570 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:21.172523 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:21.172570 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:21.172542 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:21.173132 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:21.172651 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:21.173132 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:21.172664 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:21.173132 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:21.172737 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:21.173132 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:21.172840 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:22.785430 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:22.785386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:22.785981 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:22.785472 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:22.785981 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:22.785584 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:22.785981 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:22.785602 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:22.785981 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:22.785639 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret podName:e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:38.785621723 +0000 UTC m=+34.083049000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret") pod "global-pull-secret-syncer-nwnhp" (UID: "e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:22.785981 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:22.785666 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs podName:15eee511-4e3b-4641-971b-de9c85afef15 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:38.785646418 +0000 UTC m=+34.083073696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs") pod "network-metrics-daemon-l6ts2" (UID: "15eee511-4e3b-4641-971b-de9c85afef15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:22.987667 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:22.987644 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:22.987786 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:22.987774 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:22.987823 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:22.987790 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:22.987823 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:22.987799 2567 projected.go:196] Error preparing data for projected volume kube-api-access-t5tc6 for pod openshift-network-diagnostics/network-check-target-mbrzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:22.987886 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:22.987842 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6 podName:5e870bc9-d72c-4db6-a649-5ab17939ae45 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:38.987831048 +0000 UTC m=+34.285258324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5tc6" (UniqueName: "kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6") pod "network-check-target-mbrzx" (UID: "5e870bc9-d72c-4db6-a649-5ab17939ae45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:23.172513 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:23.172423 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:23.172676 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:23.172425 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:23.172676 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:23.172571 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:23.172676 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:23.172567 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:23.172830 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:23.172673 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:23.172830 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:23.172784 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:25.173607 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:25.173559 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:25.174081 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:25.173675 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:25.174081 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:25.173691 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:25.174081 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:25.173762 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:25.174081 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:25.173790 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:25.174081 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:25.173930 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:27.172503 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:27.172459 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:27.172503 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:27.172486 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:27.173068 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:27.172460 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:27.173068 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:27.172578 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:27.173068 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:27.172651 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:27.173068 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:27.172722 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:28.405006 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.404647 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" event={"ID":"c251020c-d2b7-4f96-be67-3e6063d48ede","Type":"ContainerStarted","Data":"cb8e280b8691a9bed2ede85684fd968f6046a3e0f3594d7ec4ad6390c18199a6"} Jul 09 22:28:28.408875 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.408847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" event={"ID":"02615a1f-2d64-4642-9b64-a6c2347cc52f","Type":"ContainerStarted","Data":"5e2259b143ed58661ab4446b7574643271bfed540ac79d2852bd1ae79bb536ff"} Jul 09 22:28:28.409022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.408936 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" event={"ID":"02615a1f-2d64-4642-9b64-a6c2347cc52f","Type":"ContainerStarted","Data":"d27de0744c9e11ea1190b12c04b6f0eddd2ad4889186c1fc13b1c348d076b701"} Jul 09 22:28:28.409022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.408984 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" event={"ID":"02615a1f-2d64-4642-9b64-a6c2347cc52f","Type":"ContainerStarted","Data":"aec385c72aacdf7d7309fddc13a5838691f642291855df15fbd8ae8113b2f9e0"} Jul 09 22:28:28.409022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.409014 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" event={"ID":"02615a1f-2d64-4642-9b64-a6c2347cc52f","Type":"ContainerStarted","Data":"8ef8e33c5cf25356a7f3cd017c0ab8a1569389b4e4982e6056ff30e0111abc96"} Jul 09 22:28:28.409155 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.409050 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" event={"ID":"02615a1f-2d64-4642-9b64-a6c2347cc52f","Type":"ContainerStarted","Data":"d6d77359f6d41d0bf3a2bdb3dd185a7e004bbaadfdbff87c1aaeb1bba787d9ca"} Jul 09 22:28:28.409155 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.409092 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" event={"ID":"02615a1f-2d64-4642-9b64-a6c2347cc52f","Type":"ContainerStarted","Data":"a67fc4507bf93e65259080ca215a0c0f645e0d34af75f639e9eda11b012b55ce"} Jul 09 22:28:28.410182 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.410153 2567 generic.go:356] "Generic (PLEG): container finished" podID="a1ba1da8-17c5-44da-96e5-dcead667aa5f" containerID="70882caa7b7a017ed36c570ddf6f62965237536176df049a06ca62eb96cf2870" exitCode=0 Jul 09 22:28:28.410266 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.410240 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" event={"ID":"a1ba1da8-17c5-44da-96e5-dcead667aa5f","Type":"ContainerDied","Data":"70882caa7b7a017ed36c570ddf6f62965237536176df049a06ca62eb96cf2870"} Jul 09 22:28:28.411513 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.411495 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mr5vv" event={"ID":"0eaea9d0-860a-407a-8473-b2fe449e6220","Type":"ContainerStarted","Data":"f94d8a1aaec8c11a976c52abaffc326ee76fdd84cf5fab2884518eee8ec93533"} Jul 09 22:28:28.412839 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.412817 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4v6h" event={"ID":"b335c969-1a70-466e-81a1-20a6309c2545","Type":"ContainerStarted","Data":"d55ad0cdd3befaf05b3d8df02ff1cd8d730c4419a7a46a829dd20c71f549d115"} Jul 09 22:28:28.414098 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.414076 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ns2b8" event={"ID":"ccdeccaf-ff58-483f-b19f-a647c6d0af7f","Type":"ContainerStarted","Data":"d6b5bc0c95576e019693405933dcf1cd7f591f4c2c38a2b0e6a1b20262a817e6"} Jul 09 22:28:28.415554 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.415521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pnfbh" event={"ID":"1b67bf4b-07c2-42b6-b12b-7b53148f3f43","Type":"ContainerStarted","Data":"49f52de42f7a9e024a35de95970c9e758be64491699e4030ab2950295fb8c4e2"} Jul 09 22:28:28.416992 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.416970 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" event={"ID":"62818975-fbda-4d7c-a825-3f5d1732c162","Type":"ContainerStarted","Data":"74771632672ce59726659496c5c92a08923fa025054c9844eb446a6e2e6a1e97"} Jul 09 22:28:28.435953 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.435885 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-228.ec2.internal" podStartSLOduration=22.435870938 podStartE2EDuration="22.435870938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:10.382371609 +0000 UTC m=+5.679798914" watchObservedRunningTime="2026-07-09 22:28:28.435870938 +0000 UTC m=+23.733298235" Jul 09 22:28:28.451346 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.451296 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ns2b8" podStartSLOduration=4.54366547 podStartE2EDuration="23.451278049s" totalImagesPullingTime="18.907612579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:28.451034641 +0000 UTC m=+23.748461938" watchObservedRunningTime="2026-07-09 22:28:28.451278049 +0000 UTC m=+23.748705396" Jul 09 22:28:28.468790 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.468737 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p4v6h" podStartSLOduration=4.5420841450000005 podStartE2EDuration="23.468716437s" totalImagesPullingTime="18.926632292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:28.467887618 +0000 UTC m=+23.765314920" watchObservedRunningTime="2026-07-09 22:28:28.468716437 +0000 UTC m=+23.766143739" Jul 09 22:28:28.488820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.488766 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cxdqj" podStartSLOduration=4.562501667 podStartE2EDuration="23.488750938s" totalImagesPullingTime="18.926249271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:28.487970209 +0000 UTC m=+23.785397508" watchObservedRunningTime="2026-07-09 22:28:28.488750938 +0000 UTC m=+23.786178235" Jul 09 22:28:28.512985 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.512934 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pnfbh" podStartSLOduration=4.533698659 podStartE2EDuration="23.512897291s" totalImagesPullingTime="18.979198632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:28.512570994 +0000 UTC m=+23.809998293" watchObservedRunningTime="2026-07-09 22:28:28.512897291 +0000 UTC m=+23.810324589" Jul 09 22:28:28.533078 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:28.533032 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mr5vv" podStartSLOduration=8.886087132 podStartE2EDuration="23.533010928s" totalImagesPullingTime="14.646923796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:28.532606205 +0000 UTC m=+23.830033504" watchObservedRunningTime="2026-07-09 22:28:28.533010928 +0000 UTC m=+23.830438227" Jul 09 22:28:29.098403 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.098376 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 22:28:29.123498 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.123414 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T22:28:29.098398901Z","UUID":"7f8984e1-6acc-46c3-a48d-1f9a96bbc67e","Handler":null,"Name":"","Endpoint":""} Jul 09 22:28:29.125362 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.125344 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 22:28:29.125456 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.125370 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 22:28:29.176277 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.176231 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:29.176277 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.176231 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:29.176555 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.176231 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:29.176555 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:29.176373 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:29.176555 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:29.176462 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:29.176734 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:29.176553 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:29.420841 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.420804 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5892" event={"ID":"c4cb5947-cdf5-48b4-8640-4b8986200ab7","Type":"ContainerStarted","Data":"85102348ac6fe294f6a35db6432cefa8ed257158f9ac4e1ec482bf8fccac519d"} Jul 09 22:28:29.423031 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.422972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" event={"ID":"c251020c-d2b7-4f96-be67-3e6063d48ede","Type":"ContainerStarted","Data":"febcb7f030142a0cf1644a6cad2659c09b545bf1db8a7c0fcba5b4d45a9d383c"} Jul 09 22:28:29.441423 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:29.441379 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l5892" podStartSLOduration=5.531934068 podStartE2EDuration="24.441363774s" totalImagesPullingTime="18.909429706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:29.440990854 +0000 UTC m=+24.738418151" watchObservedRunningTime="2026-07-09 22:28:29.441363774 +0000 UTC m=+24.738791073" Jul 09 22:28:30.344394 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:30.344355 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:30.345328 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:30.345313 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:30.428452 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:30.428082 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" event={"ID":"c251020c-d2b7-4f96-be67-3e6063d48ede","Type":"ContainerStarted","Data":"ecc545fee0ade852121ec312b37ed3b65b6bbe3809c27e6635532ea18581744d"} Jul 09 22:28:30.431809 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:30.431783 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" event={"ID":"02615a1f-2d64-4642-9b64-a6c2347cc52f","Type":"ContainerStarted","Data":"438592eaa12e035c8014a152ade6b5e9252092bda1223b98ee075e5cfd56b511"} Jul 09 22:28:30.432119 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:30.432092 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:30.432583 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:30.432560 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mr5vv" Jul 09 22:28:30.451387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:30.451338 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgnm5" podStartSLOduration=4.11097461 podStartE2EDuration="25.45132121s" totalImagesPullingTime="21.3403466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:30.450869599 +0000 UTC m=+25.748296898" watchObservedRunningTime="2026-07-09 22:28:30.45132121 +0000 UTC m=+25.748748508" Jul 09 22:28:31.175749 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:31.175722 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:31.175956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:31.175808 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:31.175956 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:31.175812 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:31.175956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:31.175835 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:31.175956 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:31.175928 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:31.176116 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:31.176028 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:33.172425 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:33.172360 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:33.173096 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:33.172360 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:33.173096 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:33.172499 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:33.173096 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:33.172492 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:33.173096 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:33.172583 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:33.173096 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:33.172666 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:34.444439 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:34.444185 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" event={"ID":"02615a1f-2d64-4642-9b64-a6c2347cc52f","Type":"ContainerStarted","Data":"99c62ed563cd9fe754a360a73d8d6897c22c026ae278c5e2ae9c2332fe1e608b"} Jul 09 22:28:34.445169 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:34.444505 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:34.446101 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:34.446079 2567 generic.go:356] "Generic (PLEG): container finished" podID="a1ba1da8-17c5-44da-96e5-dcead667aa5f" containerID="c0b042dc851a65c750b63bb780931f3b3dbd46adddd6755abd7453ef71415f52" exitCode=0 Jul 09 22:28:34.446213 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:34.446116 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" event={"ID":"a1ba1da8-17c5-44da-96e5-dcead667aa5f","Type":"ContainerDied","Data":"c0b042dc851a65c750b63bb780931f3b3dbd46adddd6755abd7453ef71415f52"} Jul 09 22:28:34.460372 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:34.460350 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:34.482684 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:34.482634 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" podStartSLOduration=10.498506889 podStartE2EDuration="29.482618147s" totalImagesPullingTime="18.984111258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:34.482400531 +0000 UTC m=+29.779827831" watchObservedRunningTime="2026-07-09 22:28:34.482618147 +0000 UTC m=+29.780045444" Jul 09 22:28:35.135152 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:35.135127 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4v6h_b335c969-1a70-466e-81a1-20a6309c2545/dns-node-resolver/0.log" Jul 09 22:28:35.175991 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:35.175962 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:35.175991 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:35.175976 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:35.175991 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:35.175975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:35.176272 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:35.176056 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:35.176272 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:35.176139 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:35.176272 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:35.176180 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:35.448490 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:35.448410 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:35.448879 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:35.448496 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:35.463653 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:35.463629 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:28:36.083144 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:36.083121 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ns2b8_ccdeccaf-ff58-483f-b19f-a647c6d0af7f/node-ca/0.log" Jul 09 22:28:36.369958 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:36.369855 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbrzx"] Jul 09 22:28:36.370116 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:36.370013 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:36.370180 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:36.370123 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:36.377721 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:36.377689 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l6ts2"] Jul 09 22:28:36.377884 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:36.377841 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:36.378001 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:36.377978 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:36.380671 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:36.380647 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nwnhp"] Jul 09 22:28:36.380798 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:36.380738 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:36.380858 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:36.380837 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:36.452530 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:36.452501 2567 generic.go:356] "Generic (PLEG): container finished" podID="a1ba1da8-17c5-44da-96e5-dcead667aa5f" containerID="3b634a476d7f61d1646d2d9f67dd3bb0946c9683390d30be25418804de6dfeac" exitCode=0 Jul 09 22:28:36.452876 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:36.452563 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" event={"ID":"a1ba1da8-17c5-44da-96e5-dcead667aa5f","Type":"ContainerDied","Data":"3b634a476d7f61d1646d2d9f67dd3bb0946c9683390d30be25418804de6dfeac"} Jul 09 22:28:38.172312 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:38.172124 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:38.172881 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:38.172124 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:38.172881 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:38.172414 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:38.172881 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:38.172124 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:38.172881 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:38.172453 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:38.172881 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:38.172520 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:38.459364 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:38.459283 2567 generic.go:356] "Generic (PLEG): container finished" podID="a1ba1da8-17c5-44da-96e5-dcead667aa5f" containerID="83a82ee9543057a9a3d6586d1e5eead34a6c25fb486940b1bcd27bc8facb120d" exitCode=0 Jul 09 22:28:38.459364 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:38.459332 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" event={"ID":"a1ba1da8-17c5-44da-96e5-dcead667aa5f","Type":"ContainerDied","Data":"83a82ee9543057a9a3d6586d1e5eead34a6c25fb486940b1bcd27bc8facb120d"} Jul 09 22:28:38.800178 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:38.800134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:38.800384 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:38.800194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:38.800384 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:38.800288 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:38.800384 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:38.800300 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:38.800384 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:38.800344 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret podName:e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb nodeName:}" failed. No retries permitted until 2026-07-09 22:29:10.800329929 +0000 UTC m=+66.097757205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret") pod "global-pull-secret-syncer-nwnhp" (UID: "e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:38.800384 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:38.800366 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs podName:15eee511-4e3b-4641-971b-de9c85afef15 nodeName:}" failed. No retries permitted until 2026-07-09 22:29:10.800348784 +0000 UTC m=+66.097776078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs") pod "network-metrics-daemon-l6ts2" (UID: "15eee511-4e3b-4641-971b-de9c85afef15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:39.001190 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:39.001102 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:39.001342 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:39.001276 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:39.001342 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:39.001299 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:39.001342 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:39.001310 2567 projected.go:196] Error preparing data for projected volume kube-api-access-t5tc6 for pod openshift-network-diagnostics/network-check-target-mbrzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:39.001457 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:39.001361 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6 podName:5e870bc9-d72c-4db6-a649-5ab17939ae45 nodeName:}" failed. No retries permitted until 2026-07-09 22:29:11.001347126 +0000 UTC m=+66.298774402 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5tc6" (UniqueName: "kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6") pod "network-check-target-mbrzx" (UID: "5e870bc9-d72c-4db6-a649-5ab17939ae45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:40.172606 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:40.172570 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:40.173235 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:40.172581 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:40.173235 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:40.172707 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:40.173235 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:40.172581 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:40.173235 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:40.172773 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:40.173235 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:40.172902 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:42.172638 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:42.172603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:42.173040 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:42.172603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:42.173040 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:42.172724 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:42.173040 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:42.172603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:42.173040 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:42.172788 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:42.173040 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:42.172857 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:44.172839 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:44.172794 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:44.173309 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:44.172799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:44.173309 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:44.172952 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:44.173309 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:44.172795 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:44.173309 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:44.173021 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:44.173309 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:44.173141 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:46.172324 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:46.172295 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:46.172324 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:46.172323 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:46.172741 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:46.172385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:46.172741 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:46.172394 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:46.172741 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:46.172466 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:46.172741 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:46.172525 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:46.478104 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:46.478066 2567 generic.go:356] "Generic (PLEG): container finished" podID="a1ba1da8-17c5-44da-96e5-dcead667aa5f" containerID="904084398d411ddf9c72d6a70c32eec55b8c69c41080dd5b2d4cecf654e9924b" exitCode=0 Jul 09 22:28:46.478275 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:46.478113 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" event={"ID":"a1ba1da8-17c5-44da-96e5-dcead667aa5f","Type":"ContainerDied","Data":"904084398d411ddf9c72d6a70c32eec55b8c69c41080dd5b2d4cecf654e9924b"} Jul 09 22:28:47.483046 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:47.483005 2567 generic.go:356] "Generic (PLEG): container finished" podID="a1ba1da8-17c5-44da-96e5-dcead667aa5f" containerID="c7fc9db011c2e152c9161b31d6206d4e78920d7a66f97210097bf3264fe18403" exitCode=0 Jul 09 22:28:47.483444 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:47.483057 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" event={"ID":"a1ba1da8-17c5-44da-96e5-dcead667aa5f","Type":"ContainerDied","Data":"c7fc9db011c2e152c9161b31d6206d4e78920d7a66f97210097bf3264fe18403"} Jul 09 22:28:48.172996 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:48.172952 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:48.172996 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:48.172989 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:48.173218 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:48.172952 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:48.173218 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:48.173072 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:48.173218 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:48.173145 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:48.173327 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:48.173233 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:48.488395 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:48.488308 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" event={"ID":"a1ba1da8-17c5-44da-96e5-dcead667aa5f","Type":"ContainerStarted","Data":"4f24c77d8e19c7cc7b101ad6839a6d7a83de646ed7b11242cdd6a1bde7e28109"} Jul 09 22:28:48.514481 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:48.514429 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jzpnc" podStartSLOduration=9.508954889 podStartE2EDuration="43.514411963s" totalImagesPullingTime="34.005457074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:48.514034511 +0000 UTC m=+43.811461809" watchObservedRunningTime="2026-07-09 22:28:48.514411963 +0000 UTC m=+43.811839260" Jul 09 22:28:50.172728 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:50.172690 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:50.173167 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:50.172788 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:50.173167 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:50.172815 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:50.173167 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:50.172703 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:50.173167 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:50.172899 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:50.173167 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:50.173013 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:52.172765 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:52.172732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:52.173213 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:52.172732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:52.173213 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:52.172831 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:52.173213 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:52.172924 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:52.173213 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:52.172732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:52.173213 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:52.172992 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:54.172763 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:54.172725 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:54.173272 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:54.172725 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:54.173272 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:54.172858 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:54.173272 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:54.172903 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:54.173272 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:54.172725 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:54.173272 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:54.172993 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:56.172576 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:56.172542 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:56.173078 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:56.172587 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:56.173078 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:56.172539 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:56.173078 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:56.172676 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:56.173078 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:56.172728 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:56.173078 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:56.172788 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:28:58.172298 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:58.172259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:28:58.172854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:58.172305 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:28:58.172854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:28:58.172358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:28:58.172854 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:58.172371 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:28:58.172854 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:58.172474 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:28:58.172854 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:28:58.172560 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:29:00.172930 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:00.172879 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:29:00.172930 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:00.172932 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:29:00.172930 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:00.172929 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:29:00.173472 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:29:00.173020 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nwnhp" podUID="e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb" Jul 09 22:29:00.173472 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:29:00.173068 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbrzx" podUID="5e870bc9-d72c-4db6-a649-5ab17939ae45" Jul 09 22:29:00.173472 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:29:00.173139 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6ts2" podUID="15eee511-4e3b-4641-971b-de9c85afef15" Jul 09 22:29:01.081240 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.081170 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-228.ec2.internal" event="NodeReady" Jul 09 22:29:01.081375 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.081317 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 22:29:01.219264 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.219227 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r9mt2"] Jul 09 22:29:01.221431 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.221414 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2rf4j"] Jul 09 22:29:01.221556 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.221540 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.223190 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.223170 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.225356 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.225340 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hnlbl\"" Jul 09 22:29:01.227588 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.227565 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 22:29:01.227588 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.227572 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 22:29:01.228430 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.227847 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 22:29:01.228430 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.227902 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 22:29:01.228430 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.227995 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f5vmj\"" Jul 09 22:29:01.228430 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.228048 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 22:29:01.228430 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.228180 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 22:29:01.251274 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.251238 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2rf4j"] Jul 09 22:29:01.260787 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.260756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5673949e-086e-4f45-95ff-adb59fca9c76-metrics-tls\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.260997 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.260835 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3eb01622-2a1a-4610-9acd-6164cf45019f-data-volume\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.260997 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.260860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3eb01622-2a1a-4610-9acd-6164cf45019f-crio-socket\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.260997 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.260880 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3eb01622-2a1a-4610-9acd-6164cf45019f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.260997 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.260905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3eb01622-2a1a-4610-9acd-6164cf45019f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.260997 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.260956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5673949e-086e-4f45-95ff-adb59fca9c76-config-volume\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.260997 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.260983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5673949e-086e-4f45-95ff-adb59fca9c76-tmp-dir\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.261329 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.261029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qplst\" (UniqueName: \"kubernetes.io/projected/3eb01622-2a1a-4610-9acd-6164cf45019f-kube-api-access-qplst\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.261329 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.261060 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbxv5\" (UniqueName: \"kubernetes.io/projected/5673949e-086e-4f45-95ff-adb59fca9c76-kube-api-access-nbxv5\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.261532 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.261511 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r9mt2"] Jul 09 22:29:01.303608 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.303579 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6cptd"] Jul 09 22:29:01.305300 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.305286 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6cptd" Jul 09 22:29:01.307795 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.307773 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xf6cr\"" Jul 09 22:29:01.307969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.307817 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 22:29:01.307969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.307895 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 22:29:01.308127 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.308111 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 22:29:01.326307 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.326278 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6cptd"] Jul 09 22:29:01.362023 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.361939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbxv5\" (UniqueName: \"kubernetes.io/projected/5673949e-086e-4f45-95ff-adb59fca9c76-kube-api-access-nbxv5\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.362023 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.361973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a265bf2b-d69e-46d4-87fe-b921739f3d25-cert\") pod \"ingress-canary-6cptd\" (UID: \"a265bf2b-d69e-46d4-87fe-b921739f3d25\") " pod="openshift-ingress-canary/ingress-canary-6cptd" Jul 09 22:29:01.362023 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.361995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5673949e-086e-4f45-95ff-adb59fca9c76-metrics-tls\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.362259 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lfhj\" (UniqueName: \"kubernetes.io/projected/a265bf2b-d69e-46d4-87fe-b921739f3d25-kube-api-access-4lfhj\") pod \"ingress-canary-6cptd\" (UID: \"a265bf2b-d69e-46d4-87fe-b921739f3d25\") " pod="openshift-ingress-canary/ingress-canary-6cptd" Jul 09 22:29:01.362259 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3eb01622-2a1a-4610-9acd-6164cf45019f-data-volume\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.362259 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362150 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3eb01622-2a1a-4610-9acd-6164cf45019f-crio-socket\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.362259 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3eb01622-2a1a-4610-9acd-6164cf45019f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.362259 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3eb01622-2a1a-4610-9acd-6164cf45019f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.362504 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5673949e-086e-4f45-95ff-adb59fca9c76-config-volume\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.362504 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5673949e-086e-4f45-95ff-adb59fca9c76-tmp-dir\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.362504 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362340 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3eb01622-2a1a-4610-9acd-6164cf45019f-crio-socket\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.362504 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362351 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qplst\" (UniqueName: \"kubernetes.io/projected/3eb01622-2a1a-4610-9acd-6164cf45019f-kube-api-access-qplst\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.362504 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362461 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3eb01622-2a1a-4610-9acd-6164cf45019f-data-volume\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.362760 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362641 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5673949e-086e-4f45-95ff-adb59fca9c76-tmp-dir\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.362841 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3eb01622-2a1a-4610-9acd-6164cf45019f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.362906 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.362887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5673949e-086e-4f45-95ff-adb59fca9c76-config-volume\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.366075 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.366051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3eb01622-2a1a-4610-9acd-6164cf45019f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.366191 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.366058 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5673949e-086e-4f45-95ff-adb59fca9c76-metrics-tls\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.382309 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.382283 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbxv5\" (UniqueName: \"kubernetes.io/projected/5673949e-086e-4f45-95ff-adb59fca9c76-kube-api-access-nbxv5\") pod \"dns-default-r9mt2\" (UID: \"5673949e-086e-4f45-95ff-adb59fca9c76\") " pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.382416 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.382320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qplst\" (UniqueName: \"kubernetes.io/projected/3eb01622-2a1a-4610-9acd-6164cf45019f-kube-api-access-qplst\") pod \"insights-runtime-extractor-2rf4j\" (UID: \"3eb01622-2a1a-4610-9acd-6164cf45019f\") " pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.463157 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.463118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lfhj\" (UniqueName: \"kubernetes.io/projected/a265bf2b-d69e-46d4-87fe-b921739f3d25-kube-api-access-4lfhj\") pod \"ingress-canary-6cptd\" (UID: \"a265bf2b-d69e-46d4-87fe-b921739f3d25\") " pod="openshift-ingress-canary/ingress-canary-6cptd" Jul 09 22:29:01.463318 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.463199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a265bf2b-d69e-46d4-87fe-b921739f3d25-cert\") pod \"ingress-canary-6cptd\" (UID: \"a265bf2b-d69e-46d4-87fe-b921739f3d25\") " pod="openshift-ingress-canary/ingress-canary-6cptd" Jul 09 22:29:01.465482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.465454 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a265bf2b-d69e-46d4-87fe-b921739f3d25-cert\") pod \"ingress-canary-6cptd\" (UID: \"a265bf2b-d69e-46d4-87fe-b921739f3d25\") " pod="openshift-ingress-canary/ingress-canary-6cptd" Jul 09 22:29:01.472640 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.472610 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lfhj\" (UniqueName: \"kubernetes.io/projected/a265bf2b-d69e-46d4-87fe-b921739f3d25-kube-api-access-4lfhj\") pod \"ingress-canary-6cptd\" (UID: \"a265bf2b-d69e-46d4-87fe-b921739f3d25\") " pod="openshift-ingress-canary/ingress-canary-6cptd" Jul 09 22:29:01.530863 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.530831 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:01.536336 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.536315 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2rf4j" Jul 09 22:29:01.613470 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.613116 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6cptd" Jul 09 22:29:01.725570 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.725538 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2rf4j"] Jul 09 22:29:01.728423 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:01.728397 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb01622_2a1a_4610_9acd_6164cf45019f.slice/crio-98750c23587faf322eba0792d33492d9678ddd7aaf256c006c3c74ffa8d00fe2 WatchSource:0}: Error finding container 98750c23587faf322eba0792d33492d9678ddd7aaf256c006c3c74ffa8d00fe2: Status 404 returned error can't find the container with id 98750c23587faf322eba0792d33492d9678ddd7aaf256c006c3c74ffa8d00fe2 Jul 09 22:29:01.738387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.738360 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r9mt2"] Jul 09 22:29:01.741503 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:01.741465 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5673949e_086e_4f45_95ff_adb59fca9c76.slice/crio-46d56ef8ce248790ea55c52d99117beec57b3f0dae2b748b3b56cc53d67591ec WatchSource:0}: Error finding container 46d56ef8ce248790ea55c52d99117beec57b3f0dae2b748b3b56cc53d67591ec: Status 404 returned error can't find the container with id 46d56ef8ce248790ea55c52d99117beec57b3f0dae2b748b3b56cc53d67591ec Jul 09 22:29:01.882320 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:01.882050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6cptd"] Jul 09 22:29:01.884474 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:01.884440 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda265bf2b_d69e_46d4_87fe_b921739f3d25.slice/crio-27cbd8df0d5a6e2ee11efcffdf04d7d0838b4a07d07f4385c2263b7a10e8dca9 WatchSource:0}: Error finding container 27cbd8df0d5a6e2ee11efcffdf04d7d0838b4a07d07f4385c2263b7a10e8dca9: Status 404 returned error can't find the container with id 27cbd8df0d5a6e2ee11efcffdf04d7d0838b4a07d07f4385c2263b7a10e8dca9 Jul 09 22:29:02.173993 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.172767 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:29:02.173993 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.172770 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:29:02.173993 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.172772 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:29:02.180360 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.180188 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 22:29:02.181335 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.181311 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2swrh\"" Jul 09 22:29:02.181459 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.181415 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 22:29:02.181530 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.181520 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 22:29:02.181581 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.181562 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9x2j\"" Jul 09 22:29:02.184547 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.184520 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 22:29:02.429361 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.428276 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b"] Jul 09 22:29:02.431348 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.430734 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" Jul 09 22:29:02.435545 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.435510 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pghxg\"" Jul 09 22:29:02.435853 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.435836 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 22:29:02.470187 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.470133 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7949bf2f-b86c-491f-bb20-7583a7a2ca23-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vpn8b\" (UID: \"7949bf2f-b86c-491f-bb20-7583a7a2ca23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" Jul 09 22:29:02.478614 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.477529 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b"] Jul 09 22:29:02.524512 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.524469 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6cptd" event={"ID":"a265bf2b-d69e-46d4-87fe-b921739f3d25","Type":"ContainerStarted","Data":"27cbd8df0d5a6e2ee11efcffdf04d7d0838b4a07d07f4385c2263b7a10e8dca9"} Jul 09 22:29:02.527957 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.527929 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rf4j" event={"ID":"3eb01622-2a1a-4610-9acd-6164cf45019f","Type":"ContainerStarted","Data":"98750c23587faf322eba0792d33492d9678ddd7aaf256c006c3c74ffa8d00fe2"} Jul 09 22:29:02.529945 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.529901 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9mt2" event={"ID":"5673949e-086e-4f45-95ff-adb59fca9c76","Type":"ContainerStarted","Data":"46d56ef8ce248790ea55c52d99117beec57b3f0dae2b748b3b56cc53d67591ec"} Jul 09 22:29:02.571284 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.571245 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7949bf2f-b86c-491f-bb20-7583a7a2ca23-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vpn8b\" (UID: \"7949bf2f-b86c-491f-bb20-7583a7a2ca23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" Jul 09 22:29:02.589746 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.586359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7949bf2f-b86c-491f-bb20-7583a7a2ca23-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vpn8b\" (UID: \"7949bf2f-b86c-491f-bb20-7583a7a2ca23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" Jul 09 22:29:02.743840 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.743758 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" Jul 09 22:29:02.941142 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:02.941099 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b"] Jul 09 22:29:02.952170 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:02.951300 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7949bf2f_b86c_491f_bb20_7583a7a2ca23.slice/crio-15574b7f1aee2050dfbc012466f08ba658b8f3c9fd67932a0c7e7a4b92f10954 WatchSource:0}: Error finding container 15574b7f1aee2050dfbc012466f08ba658b8f3c9fd67932a0c7e7a4b92f10954: Status 404 returned error can't find the container with id 15574b7f1aee2050dfbc012466f08ba658b8f3c9fd67932a0c7e7a4b92f10954 Jul 09 22:29:03.534879 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:03.534804 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" event={"ID":"7949bf2f-b86c-491f-bb20-7583a7a2ca23","Type":"ContainerStarted","Data":"15574b7f1aee2050dfbc012466f08ba658b8f3c9fd67932a0c7e7a4b92f10954"} Jul 09 22:29:04.552761 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.552720 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9fc96df89-fwhrz"] Jul 09 22:29:04.558352 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.558318 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.564292 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.564020 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 22:29:04.564292 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.564113 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 22:29:04.564292 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.564177 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 22:29:04.564517 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.564369 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 22:29:04.564517 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.564441 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 22:29:04.565312 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.565285 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 22:29:04.565435 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.565360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jzppb\"" Jul 09 22:29:04.570363 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.570346 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 22:29:04.590116 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.590082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-oauth-config\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.590116 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.590125 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-oauth-serving-cert\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.590350 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.590166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-serving-cert\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.590350 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.590237 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-service-ca\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.590350 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.590281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qsh\" (UniqueName: \"kubernetes.io/projected/75b27c1c-2968-4dc4-a181-ede9e612af3b-kube-api-access-67qsh\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.590350 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.590319 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-config\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.609825 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.609794 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9fc96df89-fwhrz"] Jul 09 22:29:04.691657 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.691625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-oauth-config\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.691657 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.691661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-oauth-serving-cert\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.691898 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.691685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-serving-cert\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.691898 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.691718 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-service-ca\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.691898 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.691765 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qsh\" (UniqueName: \"kubernetes.io/projected/75b27c1c-2968-4dc4-a181-ede9e612af3b-kube-api-access-67qsh\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.691898 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.691802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-config\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.692515 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.692463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-oauth-serving-cert\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.692660 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.692635 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-service-ca\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.692739 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.692644 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-config\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.694479 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.694453 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-oauth-config\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.694579 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.694499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-serving-cert\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.703715 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.703689 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qsh\" (UniqueName: \"kubernetes.io/projected/75b27c1c-2968-4dc4-a181-ede9e612af3b-kube-api-access-67qsh\") pod \"console-9fc96df89-fwhrz\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:04.869659 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:04.869569 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:07.475989 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:07.475956 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x4dh" Jul 09 22:29:07.599480 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:07.599438 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9fc96df89-fwhrz"] Jul 09 22:29:07.606268 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:07.606223 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b27c1c_2968_4dc4_a181_ede9e612af3b.slice/crio-7370c77f5c6366679a2baeab70f329ffc4705c2dacce381502b092b79754a2eb WatchSource:0}: Error finding container 7370c77f5c6366679a2baeab70f329ffc4705c2dacce381502b092b79754a2eb: Status 404 returned error can't find the container with id 7370c77f5c6366679a2baeab70f329ffc4705c2dacce381502b092b79754a2eb Jul 09 22:29:08.550941 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.550766 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6cptd" event={"ID":"a265bf2b-d69e-46d4-87fe-b921739f3d25","Type":"ContainerStarted","Data":"b4f0f38699096a0f5adaa69b969ebdfe597f7e705a64f4c95081e003cd26f904"} Jul 09 22:29:08.552794 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.552761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rf4j" event={"ID":"3eb01622-2a1a-4610-9acd-6164cf45019f","Type":"ContainerStarted","Data":"8b6b8a8f5e5f2ca905e60e268e87f824962463667d8fb34e4049d46a97f3dce5"} Jul 09 22:29:08.552926 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.552815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rf4j" event={"ID":"3eb01622-2a1a-4610-9acd-6164cf45019f","Type":"ContainerStarted","Data":"fa706c3dfec6597637fe3bac7530c75dce37d4cd7e94166110f768b6015e4d45"} Jul 09 22:29:08.554695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.554669 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9mt2" event={"ID":"5673949e-086e-4f45-95ff-adb59fca9c76","Type":"ContainerStarted","Data":"8c6a2fd44155e116a547c1d441a3b1d93e6c7903d80aebe66b16d65bdbd3e44d"} Jul 09 22:29:08.554819 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.554721 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9mt2" event={"ID":"5673949e-086e-4f45-95ff-adb59fca9c76","Type":"ContainerStarted","Data":"ef80ee54f4ca94fb53e37a3b2451c5e1de989731b6a24aac5026ac572ddfd4f8"} Jul 09 22:29:08.554819 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.554765 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:08.556393 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.556370 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" event={"ID":"7949bf2f-b86c-491f-bb20-7583a7a2ca23","Type":"ContainerStarted","Data":"fcd18b6b57ac50b62aa99deb0267faf1245d29c877546ea04168d1cb7d7c173e"} Jul 09 22:29:08.556561 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.556535 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" Jul 09 22:29:08.557898 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.557872 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fc96df89-fwhrz" event={"ID":"75b27c1c-2968-4dc4-a181-ede9e612af3b","Type":"ContainerStarted","Data":"7370c77f5c6366679a2baeab70f329ffc4705c2dacce381502b092b79754a2eb"} Jul 09 22:29:08.562822 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.562796 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" Jul 09 22:29:08.672174 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.672128 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6cptd" podStartSLOduration=2.126520741 podStartE2EDuration="7.6721124s" totalImagesPullingTime="5.545591659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:08.608570206 +0000 UTC m=+63.905997504" watchObservedRunningTime="2026-07-09 22:29:08.6721124 +0000 UTC m=+63.969539676" Jul 09 22:29:08.672341 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:08.672264 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r9mt2" podStartSLOduration=1.9859302049999998 podStartE2EDuration="7.67225913s" totalImagesPullingTime="5.686328925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:08.668818951 +0000 UTC m=+63.966246253" watchObservedRunningTime="2026-07-09 22:29:08.67225913 +0000 UTC m=+63.969686424" Jul 09 22:29:09.708142 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.708013 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vpn8b" podStartSLOduration=3.23316852 podStartE2EDuration="7.707995771s" totalImagesPullingTime="4.474827251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:08.7199672 +0000 UTC m=+64.017394503" watchObservedRunningTime="2026-07-09 22:29:09.707995771 +0000 UTC m=+65.005423068" Jul 09 22:29:09.708610 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.708343 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs"] Jul 09 22:29:09.710628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.710597 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.717087 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.717060 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 22:29:09.717309 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.717197 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 22:29:09.717646 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.717465 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 22:29:09.718295 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.718135 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 22:29:09.718295 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.718220 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mzlt9\"" Jul 09 22:29:09.719104 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.719085 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 22:29:09.806613 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.806579 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs"] Jul 09 22:29:09.828564 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.828531 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cd58c764-pzhp4"] Jul 09 22:29:09.831790 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.831768 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:09.835803 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.835771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.835971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.835856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.835971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.835883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.835971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.835952 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwcvx\" (UniqueName: \"kubernetes.io/projected/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-kube-api-access-wwcvx\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.844320 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.844294 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 22:29:09.858282 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.858253 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd58c764-pzhp4"] Jul 09 22:29:09.936458 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.936643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.936643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936568 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-oauth-serving-cert\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:09.936643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhm45\" (UniqueName: \"kubernetes.io/projected/4924659a-e029-43c5-9671-0938e65f6150-kube-api-access-xhm45\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:09.936643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936630 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-console-config\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:09.936849 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-service-ca\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:09.936849 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936693 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwcvx\" (UniqueName: \"kubernetes.io/projected/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-kube-api-access-wwcvx\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.936849 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:29:09.936708 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 22:29:09.936849 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936731 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.936849 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936759 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-trusted-ca-bundle\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:09.936849 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:29:09.936783 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-tls podName:fccca4d4-a8fc-4bd6-9071-6ec26bbfc738 nodeName:}" failed. No retries permitted until 2026-07-09 22:29:10.436759786 +0000 UTC m=+65.734187081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-z8bfs" (UID: "fccca4d4-a8fc-4bd6-9071-6ec26bbfc738") : secret "prometheus-operator-tls" not found Jul 09 22:29:09.936849 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936828 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-oauth-config\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:09.937110 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.936862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-serving-cert\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:09.937257 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.937235 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.939443 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.939391 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:09.957352 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:09.957324 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwcvx\" (UniqueName: \"kubernetes.io/projected/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-kube-api-access-wwcvx\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:10.038016 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.037981 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-oauth-serving-cert\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.038203 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.038029 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhm45\" (UniqueName: \"kubernetes.io/projected/4924659a-e029-43c5-9671-0938e65f6150-kube-api-access-xhm45\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.038268 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.038220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-console-config\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.038268 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.038254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-service-ca\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.038342 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.038296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-trusted-ca-bundle\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.038342 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.038326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-oauth-config\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.038548 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.038517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-serving-cert\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.038900 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.038868 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-oauth-serving-cert\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.039084 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.039058 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-service-ca\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.039214 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.039186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-console-config\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.039345 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.039308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-trusted-ca-bundle\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.041140 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.041100 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-oauth-config\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.041306 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.041287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-serving-cert\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.054886 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.054857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhm45\" (UniqueName: \"kubernetes.io/projected/4924659a-e029-43c5-9671-0938e65f6150-kube-api-access-xhm45\") pod \"console-5cd58c764-pzhp4\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.141353 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.141298 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:10.442497 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.442378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:10.442639 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:29:10.442561 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 22:29:10.442639 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:29:10.442632 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-tls podName:fccca4d4-a8fc-4bd6-9071-6ec26bbfc738 nodeName:}" failed. No retries permitted until 2026-07-09 22:29:11.442615436 +0000 UTC m=+66.740042712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-z8bfs" (UID: "fccca4d4-a8fc-4bd6-9071-6ec26bbfc738") : secret "prometheus-operator-tls" not found Jul 09 22:29:10.846626 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.846592 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:29:10.847046 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.846645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:29:10.852354 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.852322 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 22:29:10.853202 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.853180 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 22:29:10.859651 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.859616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15eee511-4e3b-4641-971b-de9c85afef15-metrics-certs\") pod \"network-metrics-daemon-l6ts2\" (UID: \"15eee511-4e3b-4641-971b-de9c85afef15\") " pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:29:10.859767 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.859616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb-original-pull-secret\") pod \"global-pull-secret-syncer-nwnhp\" (UID: \"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb\") " pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:29:10.893283 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.893251 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9x2j\"" Jul 09 22:29:10.899753 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.899725 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6ts2" Jul 09 22:29:10.905732 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:10.905710 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nwnhp" Jul 09 22:29:11.049073 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:11.049035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:29:11.052703 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:11.052678 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 22:29:11.062893 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:11.062865 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 22:29:11.073217 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:11.073184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5tc6\" (UniqueName: \"kubernetes.io/projected/5e870bc9-d72c-4db6-a649-5ab17939ae45-kube-api-access-t5tc6\") pod \"network-check-target-mbrzx\" (UID: \"5e870bc9-d72c-4db6-a649-5ab17939ae45\") " pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:29:11.202439 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:11.202360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2swrh\"" Jul 09 22:29:11.209954 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:11.209901 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:29:11.453594 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:11.453487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:11.456352 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:11.456322 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccca4d4-a8fc-4bd6-9071-6ec26bbfc738-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-z8bfs\" (UID: \"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:11.522644 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:11.522612 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" Jul 09 22:29:12.147691 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.147653 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l6ts2"] Jul 09 22:29:12.152747 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:12.152712 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15eee511_4e3b_4641_971b_de9c85afef15.slice/crio-f36309f55f2505f3783aec6cb7e5a714812e00e64a5e891e2d6f6faef20e9f88 WatchSource:0}: Error finding container f36309f55f2505f3783aec6cb7e5a714812e00e64a5e891e2d6f6faef20e9f88: Status 404 returned error can't find the container with id f36309f55f2505f3783aec6cb7e5a714812e00e64a5e891e2d6f6faef20e9f88 Jul 09 22:29:12.154361 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.153888 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbrzx"] Jul 09 22:29:12.155868 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:12.155839 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e870bc9_d72c_4db6_a649_5ab17939ae45.slice/crio-f598285214b38eef96ea92642940f50549fc48ed7df3deb2cc73e51aef139db0 WatchSource:0}: Error finding container f598285214b38eef96ea92642940f50549fc48ed7df3deb2cc73e51aef139db0: Status 404 returned error can't find the container with id f598285214b38eef96ea92642940f50549fc48ed7df3deb2cc73e51aef139db0 Jul 09 22:29:12.179832 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.179767 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs"] Jul 09 22:29:12.182837 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:12.182801 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccca4d4_a8fc_4bd6_9071_6ec26bbfc738.slice/crio-6e45de5917193d80211eeb855345e400bec9b85f5798d55a182109821f79e89d WatchSource:0}: Error finding container 6e45de5917193d80211eeb855345e400bec9b85f5798d55a182109821f79e89d: Status 404 returned error can't find the container with id 6e45de5917193d80211eeb855345e400bec9b85f5798d55a182109821f79e89d Jul 09 22:29:12.403923 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.403878 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nwnhp"] Jul 09 22:29:12.409088 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:12.409063 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80bba4c_ad62_4e7b_887f_bcfa4dcee8bb.slice/crio-96cfa6ca7b10423e53302161c301b6ff2e16b37d4705f440b448bdc45876659c WatchSource:0}: Error finding container 96cfa6ca7b10423e53302161c301b6ff2e16b37d4705f440b448bdc45876659c: Status 404 returned error can't find the container with id 96cfa6ca7b10423e53302161c301b6ff2e16b37d4705f440b448bdc45876659c Jul 09 22:29:12.410203 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:12.410177 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4924659a_e029_43c5_9671_0938e65f6150.slice/crio-a2a216ddadb4f87232127b731b3301c0a94470e312fc4d757d8ff87151721a95 WatchSource:0}: Error finding container a2a216ddadb4f87232127b731b3301c0a94470e312fc4d757d8ff87151721a95: Status 404 returned error can't find the container with id a2a216ddadb4f87232127b731b3301c0a94470e312fc4d757d8ff87151721a95 Jul 09 22:29:12.412530 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.412511 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd58c764-pzhp4"] Jul 09 22:29:12.574408 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.574366 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbrzx" event={"ID":"5e870bc9-d72c-4db6-a649-5ab17939ae45","Type":"ContainerStarted","Data":"f598285214b38eef96ea92642940f50549fc48ed7df3deb2cc73e51aef139db0"} Jul 09 22:29:12.576623 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.576598 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fc96df89-fwhrz" event={"ID":"75b27c1c-2968-4dc4-a181-ede9e612af3b","Type":"ContainerStarted","Data":"65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e"} Jul 09 22:29:12.577857 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.577834 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nwnhp" event={"ID":"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb","Type":"ContainerStarted","Data":"96cfa6ca7b10423e53302161c301b6ff2e16b37d4705f440b448bdc45876659c"} Jul 09 22:29:12.579135 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.579109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l6ts2" event={"ID":"15eee511-4e3b-4641-971b-de9c85afef15","Type":"ContainerStarted","Data":"f36309f55f2505f3783aec6cb7e5a714812e00e64a5e891e2d6f6faef20e9f88"} Jul 09 22:29:12.581665 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.581639 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rf4j" event={"ID":"3eb01622-2a1a-4610-9acd-6164cf45019f","Type":"ContainerStarted","Data":"17069f04d575fe0b50ec51c71ed54efee82138fa0477aa28599ee10941527232"} Jul 09 22:29:12.583872 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.583840 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd58c764-pzhp4" event={"ID":"4924659a-e029-43c5-9671-0938e65f6150","Type":"ContainerStarted","Data":"6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f"} Jul 09 22:29:12.583990 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.583882 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd58c764-pzhp4" event={"ID":"4924659a-e029-43c5-9671-0938e65f6150","Type":"ContainerStarted","Data":"a2a216ddadb4f87232127b731b3301c0a94470e312fc4d757d8ff87151721a95"} Jul 09 22:29:12.585202 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.585154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" event={"ID":"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738","Type":"ContainerStarted","Data":"6e45de5917193d80211eeb855345e400bec9b85f5798d55a182109821f79e89d"} Jul 09 22:29:12.680231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.680174 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9fc96df89-fwhrz" podStartSLOduration=4.421248516 podStartE2EDuration="8.680157928s" totalImagesPullingTime="4.258909412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:12.625495104 +0000 UTC m=+67.922922404" watchObservedRunningTime="2026-07-09 22:29:12.680157928 +0000 UTC m=+67.977585227" Jul 09 22:29:12.680448 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.680311 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cd58c764-pzhp4" podStartSLOduration=3.680305037 podStartE2EDuration="3.680305037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:12.679649906 +0000 UTC m=+67.977077209" watchObservedRunningTime="2026-07-09 22:29:12.680305037 +0000 UTC m=+67.977732335" Jul 09 22:29:12.734267 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:12.734179 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2rf4j" podStartSLOduration=1.6786367800000002 podStartE2EDuration="11.734148843s" totalImagesPullingTime="10.055512063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:29:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:12.733671614 +0000 UTC m=+68.031098912" watchObservedRunningTime="2026-07-09 22:29:12.734148843 +0000 UTC m=+68.031576144" Jul 09 22:29:14.599294 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:14.599254 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" event={"ID":"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738","Type":"ContainerStarted","Data":"d7df2605ff4d0e703afe5114b7fa58318352128b63e57a5e751dceea0cdf774b"} Jul 09 22:29:14.599802 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:14.599352 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" event={"ID":"fccca4d4-a8fc-4bd6-9071-6ec26bbfc738","Type":"ContainerStarted","Data":"4fe28dbe912e495f1cf79937267a580f71d05c9e491f299f7a537ee0866d0dd7"} Jul 09 22:29:14.601518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:14.601491 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l6ts2" event={"ID":"15eee511-4e3b-4641-971b-de9c85afef15","Type":"ContainerStarted","Data":"573434ac9bd35644f3cc20a86eb1e0a4b9311254a27ab18184f362fe3b476d99"} Jul 09 22:29:14.601643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:14.601541 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l6ts2" event={"ID":"15eee511-4e3b-4641-971b-de9c85afef15","Type":"ContainerStarted","Data":"696632ed05766060f1fa7ee0978cbc5689cbe47a9da8e604c5025f07ea0594ca"} Jul 09 22:29:14.624751 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:14.624683 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-z8bfs" podStartSLOduration=3.928203686 podStartE2EDuration="5.624661549s" totalImagesPullingTime="1.696457863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:14.622607443 +0000 UTC m=+69.920034758" watchObservedRunningTime="2026-07-09 22:29:14.624661549 +0000 UTC m=+69.922088863" Jul 09 22:29:14.656724 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:14.656632 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l6ts2" podStartSLOduration=67.935534276 podStartE2EDuration="1m9.656615242s" totalImagesPullingTime="1.721080966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:14.654854415 +0000 UTC m=+69.952281715" watchObservedRunningTime="2026-07-09 22:29:14.656615242 +0000 UTC m=+69.954042539" Jul 09 22:29:14.870378 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:14.870289 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:14.870378 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:14.870363 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:14.877979 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:14.877951 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:15.611141 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:15.611114 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:17.286000 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.284005 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2"] Jul 09 22:29:17.288232 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.288209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.306624 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.306593 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 22:29:17.307215 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.307192 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 22:29:17.307664 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.307647 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nxl8d\"" Jul 09 22:29:17.341274 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.341243 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q"] Jul 09 22:29:17.344407 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.344348 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2"] Jul 09 22:29:17.344521 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.344483 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.347330 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.347310 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 22:29:17.347963 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.347945 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 22:29:17.348062 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.348053 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 22:29:17.348185 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.348170 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lht4j\"" Jul 09 22:29:17.376464 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.376431 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n9jqr"] Jul 09 22:29:17.379576 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.379555 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q"] Jul 09 22:29:17.379696 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.379664 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.389404 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.389383 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 22:29:17.389512 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.389468 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4smjs\"" Jul 09 22:29:17.392403 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.392385 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 22:29:17.393329 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.393315 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 22:29:17.406437 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36cc8503-5e66-4696-bab6-279da732d141-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.406615 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cacccc19-140b-458a-933e-329eb96fe902-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.406615 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36cc8503-5e66-4696-bab6-279da732d141-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.406615 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36cc8503-5e66-4696-bab6-279da732d141-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.406615 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cacccc19-140b-458a-933e-329eb96fe902-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.406615 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacccc19-140b-458a-933e-329eb96fe902-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.406847 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nllv\" (UniqueName: \"kubernetes.io/projected/36cc8503-5e66-4696-bab6-279da732d141-kube-api-access-4nllv\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.406847 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cacccc19-140b-458a-933e-329eb96fe902-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.406847 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm2wn\" (UniqueName: \"kubernetes.io/projected/cacccc19-140b-458a-933e-329eb96fe902-kube-api-access-lm2wn\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.406847 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.406767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cacccc19-140b-458a-933e-329eb96fe902-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.508160 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5cef037-6b09-431d-8fca-f5e55ead2078-metrics-client-ca\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.508327 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508176 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36cc8503-5e66-4696-bab6-279da732d141-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.508327 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508207 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cacccc19-140b-458a-933e-329eb96fe902-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.508327 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-wtmp\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.508327 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacccc19-140b-458a-933e-329eb96fe902-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.508327 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-tls\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.508327 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508300 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nllv\" (UniqueName: \"kubernetes.io/projected/36cc8503-5e66-4696-bab6-279da732d141-kube-api-access-4nllv\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.508695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508391 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cacccc19-140b-458a-933e-329eb96fe902-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.508695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2wn\" (UniqueName: \"kubernetes.io/projected/cacccc19-140b-458a-933e-329eb96fe902-kube-api-access-lm2wn\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.508695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5cef037-6b09-431d-8fca-f5e55ead2078-root\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.508695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508620 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cacccc19-140b-458a-933e-329eb96fe902-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.508695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cacccc19-140b-458a-933e-329eb96fe902-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.508695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5cef037-6b09-431d-8fca-f5e55ead2078-sys\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.508695 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-textfile\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.509063 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.509063 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36cc8503-5e66-4696-bab6-279da732d141-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.509063 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508779 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25s5h\" (UniqueName: \"kubernetes.io/projected/c5cef037-6b09-431d-8fca-f5e55ead2078-kube-api-access-25s5h\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.509063 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cacccc19-140b-458a-933e-329eb96fe902-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.509063 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36cc8503-5e66-4696-bab6-279da732d141-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.509063 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.508869 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.509373 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.509337 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cacccc19-140b-458a-933e-329eb96fe902-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.509449 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.509423 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cacccc19-140b-458a-933e-329eb96fe902-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.509585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.509559 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36cc8503-5e66-4696-bab6-279da732d141-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.510838 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.510820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36cc8503-5e66-4696-bab6-279da732d141-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.510960 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.510849 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacccc19-140b-458a-933e-329eb96fe902-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.511590 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.511567 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cacccc19-140b-458a-933e-329eb96fe902-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.511666 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.511615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36cc8503-5e66-4696-bab6-279da732d141-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.520585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.520560 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm2wn\" (UniqueName: \"kubernetes.io/projected/cacccc19-140b-458a-933e-329eb96fe902-kube-api-access-lm2wn\") pod \"kube-state-metrics-7c9dbb8b7d-xk96q\" (UID: \"cacccc19-140b-458a-933e-329eb96fe902\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.525582 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.525559 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nllv\" (UniqueName: \"kubernetes.io/projected/36cc8503-5e66-4696-bab6-279da732d141-kube-api-access-4nllv\") pod \"openshift-state-metrics-54cf96dfcf-vdhx2\" (UID: \"36cc8503-5e66-4696-bab6-279da732d141\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.596602 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.596507 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" Jul 09 22:29:17.610226 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610353 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25s5h\" (UniqueName: \"kubernetes.io/projected/c5cef037-6b09-431d-8fca-f5e55ead2078-kube-api-access-25s5h\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610353 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610353 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610341 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5cef037-6b09-431d-8fca-f5e55ead2078-metrics-client-ca\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610512 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610381 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-wtmp\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610512 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-tls\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610512 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5cef037-6b09-431d-8fca-f5e55ead2078-root\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610512 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5cef037-6b09-431d-8fca-f5e55ead2078-sys\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610740 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610521 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-textfile\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610826 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610801 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610901 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610858 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-textfile\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610979 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610901 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5cef037-6b09-431d-8fca-f5e55ead2078-root\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.610979 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610956 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5cef037-6b09-431d-8fca-f5e55ead2078-sys\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.611066 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.610987 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5cef037-6b09-431d-8fca-f5e55ead2078-metrics-client-ca\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.611066 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.611041 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-wtmp\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.612994 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.612968 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-tls\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.613098 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.613085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5cef037-6b09-431d-8fca-f5e55ead2078-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.614752 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.614726 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbrzx" event={"ID":"5e870bc9-d72c-4db6-a649-5ab17939ae45","Type":"ContainerStarted","Data":"a5dea2862b0376e0648edbfd844f61b460c6387c0ee88598943e5209cd70372e"} Jul 09 22:29:17.614847 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.614822 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:29:17.616307 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.616284 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nwnhp" event={"ID":"e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb","Type":"ContainerStarted","Data":"5d3f210c8a94c0efe4569a8f6e8342a3cff289ab0eb7bbb8e5bd813955e41261"} Jul 09 22:29:17.624243 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.624222 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25s5h\" (UniqueName: \"kubernetes.io/projected/c5cef037-6b09-431d-8fca-f5e55ead2078-kube-api-access-25s5h\") pod \"node-exporter-n9jqr\" (UID: \"c5cef037-6b09-431d-8fca-f5e55ead2078\") " pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.655718 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.655692 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" Jul 09 22:29:17.671676 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.671628 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mbrzx" podStartSLOduration=67.735499671 podStartE2EDuration="1m12.671611957s" totalImagesPullingTime="4.936112286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:17.638668443 +0000 UTC m=+72.936095741" watchObservedRunningTime="2026-07-09 22:29:17.671611957 +0000 UTC m=+72.969039263" Jul 09 22:29:17.688317 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.688288 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9jqr" Jul 09 22:29:17.742991 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.742905 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nwnhp" podStartSLOduration=68.052598138 podStartE2EDuration="1m12.742882827s" totalImagesPullingTime="4.690284689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:17.672949498 +0000 UTC m=+72.970376797" watchObservedRunningTime="2026-07-09 22:29:17.742882827 +0000 UTC m=+73.040310126" Jul 09 22:29:17.743480 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.743461 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2"] Jul 09 22:29:17.747201 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:17.747172 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36cc8503_5e66_4696_bab6_279da732d141.slice/crio-d25f7dbff00af5ecc6e5f32d8b3b57c18eafeceda0c6f519c28e74bb20ffd9b1 WatchSource:0}: Error finding container d25f7dbff00af5ecc6e5f32d8b3b57c18eafeceda0c6f519c28e74bb20ffd9b1: Status 404 returned error can't find the container with id d25f7dbff00af5ecc6e5f32d8b3b57c18eafeceda0c6f519c28e74bb20ffd9b1 Jul 09 22:29:17.818189 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:17.818155 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q"] Jul 09 22:29:17.823923 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:17.823874 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacccc19_140b_458a_933e_329eb96fe902.slice/crio-775984b51670602d95f74c6b22f6b0635f9df22219ce5fbe9d34e23dd9d6b7b0 WatchSource:0}: Error finding container 775984b51670602d95f74c6b22f6b0635f9df22219ce5fbe9d34e23dd9d6b7b0: Status 404 returned error can't find the container with id 775984b51670602d95f74c6b22f6b0635f9df22219ce5fbe9d34e23dd9d6b7b0 Jul 09 22:29:18.558083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.557864 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 22:29:18.565678 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.565649 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r9mt2" Jul 09 22:29:18.565850 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.565713 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.579612 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.578870 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 22:29:18.579612 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.578968 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8r8ks\"" Jul 09 22:29:18.579612 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.579162 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 22:29:18.579612 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.579181 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 22:29:18.579612 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.578881 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 22:29:18.579612 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.579387 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 22:29:18.579612 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.579461 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 22:29:18.579612 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.579556 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 22:29:18.580501 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.580478 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 22:29:18.582061 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.582040 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 22:29:18.588557 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.588533 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 22:29:18.622243 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.622206 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" event={"ID":"cacccc19-140b-458a-933e-329eb96fe902","Type":"ContainerStarted","Data":"775984b51670602d95f74c6b22f6b0635f9df22219ce5fbe9d34e23dd9d6b7b0"} Jul 09 22:29:18.623874 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.623806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9jqr" event={"ID":"c5cef037-6b09-431d-8fca-f5e55ead2078","Type":"ContainerStarted","Data":"26e870b7a28815c5b77d5343602751b36712430849393e547afce7f944810afd"} Jul 09 22:29:18.627896 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.627870 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" event={"ID":"36cc8503-5e66-4696-bab6-279da732d141","Type":"ContainerStarted","Data":"2ed5bfb8abbd1746d8b27500ec967ad45b79b0196fb7752eaaa8c48f07163ba9"} Jul 09 22:29:18.628149 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.628122 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" event={"ID":"36cc8503-5e66-4696-bab6-279da732d141","Type":"ContainerStarted","Data":"e341447a87dcead93e69944dd301728fb564c62db9e2aab1b4cfae59f8508236"} Jul 09 22:29:18.628259 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.628165 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" event={"ID":"36cc8503-5e66-4696-bab6-279da732d141","Type":"ContainerStarted","Data":"d25f7dbff00af5ecc6e5f32d8b3b57c18eafeceda0c6f519c28e74bb20ffd9b1"} Jul 09 22:29:18.718518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.718518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.718518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718355 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.718518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.718518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.718518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-volume\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.719022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718616 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcprv\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-kube-api-access-dcprv\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.719022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718706 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.719022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718824 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.719022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.719022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.719022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-out\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.719022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.718896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-web-config\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820191 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820111 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcprv\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-kube-api-access-dcprv\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820191 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820395 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820395 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820237 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820395 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820395 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820294 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-out\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820395 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820316 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-web-config\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820395 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820685 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820410 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820685 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820685 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820477 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820685 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820685 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-volume\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.820685 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.820626 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.821367 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.821095 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.822171 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.821821 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.823720 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.823700 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.823894 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.823871 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-out\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.824018 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.823942 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.824702 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.824660 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.824800 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.824723 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.824956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.824931 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.826431 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.826378 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.826431 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.826382 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-volume\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.826431 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.826383 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-web-config\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.840517 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.840486 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcprv\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-kube-api-access-dcprv\") pod \"alertmanager-main-0\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:18.880059 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:18.880009 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:29:20.142213 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.141710 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:20.142213 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.142146 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:20.149154 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.148871 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:20.170548 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.170521 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:20.244643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.244596 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9fc96df89-fwhrz"] Jul 09 22:29:20.279578 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.279503 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 22:29:20.283133 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:20.283106 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a53477_40de_4d26_9eb7_9d68f5cde554.slice/crio-a747e7ae8ac8135c28ebe1df4cf358d22bcd267b693e6d682c491e2d957d5526 WatchSource:0}: Error finding container a747e7ae8ac8135c28ebe1df4cf358d22bcd267b693e6d682c491e2d957d5526: Status 404 returned error can't find the container with id a747e7ae8ac8135c28ebe1df4cf358d22bcd267b693e6d682c491e2d957d5526 Jul 09 22:29:20.440254 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.440217 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp"] Jul 09 22:29:20.443400 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.443377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.448241 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.448217 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 22:29:20.448369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.448216 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6ho4bhvj6leb2\"" Jul 09 22:29:20.448369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.448217 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 22:29:20.448682 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.448591 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 22:29:20.448742 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.448712 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-npwkg\"" Jul 09 22:29:20.448798 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.448773 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 22:29:20.449140 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.449124 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 22:29:20.475475 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.475440 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp"] Jul 09 22:29:20.536320 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.536279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.536498 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.536333 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbdlr\" (UniqueName: \"kubernetes.io/projected/358aeabd-5de9-4726-b326-a0ff5b5f2374-kube-api-access-wbdlr\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.536498 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.536422 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.536498 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.536460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-grpc-tls\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.536686 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.536497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-tls\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.536686 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.536578 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.536686 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.536605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/358aeabd-5de9-4726-b326-a0ff5b5f2374-metrics-client-ca\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.536686 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.536668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.637708 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.637605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.637708 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.637657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-grpc-tls\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.637708 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.637685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-tls\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.638030 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.637747 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.638030 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.637775 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/358aeabd-5de9-4726-b326-a0ff5b5f2374-metrics-client-ca\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.638030 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.637809 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.638030 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.637846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.638030 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.637881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbdlr\" (UniqueName: \"kubernetes.io/projected/358aeabd-5de9-4726-b326-a0ff5b5f2374-kube-api-access-wbdlr\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.638702 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.638640 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/358aeabd-5de9-4726-b326-a0ff5b5f2374-metrics-client-ca\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.640513 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.640100 2567 generic.go:356] "Generic (PLEG): container finished" podID="c5cef037-6b09-431d-8fca-f5e55ead2078" containerID="cea08c759fd08e0aef4c06a45fbaa71a0dd8c920fb31289965df53f4d31c408f" exitCode=0 Jul 09 22:29:20.640513 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.640202 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9jqr" event={"ID":"c5cef037-6b09-431d-8fca-f5e55ead2078","Type":"ContainerDied","Data":"cea08c759fd08e0aef4c06a45fbaa71a0dd8c920fb31289965df53f4d31c408f"} Jul 09 22:29:20.640861 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.640808 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.640988 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.640869 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.640988 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.640938 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.641110 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.641079 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-grpc-tls\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.641344 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.641320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.642656 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.642633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/358aeabd-5de9-4726-b326-a0ff5b5f2374-secret-thanos-querier-tls\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.643404 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.643379 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" event={"ID":"36cc8503-5e66-4696-bab6-279da732d141","Type":"ContainerStarted","Data":"8766ed3922a6d9bf398cd3a7d4b4e20f5692378361dc1bd7d04c39f32f028508"} Jul 09 22:29:20.644713 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.644692 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerStarted","Data":"a747e7ae8ac8135c28ebe1df4cf358d22bcd267b693e6d682c491e2d957d5526"} Jul 09 22:29:20.646944 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.646906 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" event={"ID":"cacccc19-140b-458a-933e-329eb96fe902","Type":"ContainerStarted","Data":"43932c5303ea3c5a5e0952af4c27dda52de2d045ba9e59b9ce4108384e29fbb6"} Jul 09 22:29:20.647008 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.646973 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" event={"ID":"cacccc19-140b-458a-933e-329eb96fe902","Type":"ContainerStarted","Data":"04a5e2f8799cb38ce9d06c68af1b4c548aa7820fcf17192df6fa08c70c757f2a"} Jul 09 22:29:20.647008 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.647001 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" event={"ID":"cacccc19-140b-458a-933e-329eb96fe902","Type":"ContainerStarted","Data":"c89929ba24b988282fb02ea79311e1eaccc1e976698e45f2f390a362ad3786fb"} Jul 09 22:29:20.651420 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.651399 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbdlr\" (UniqueName: \"kubernetes.io/projected/358aeabd-5de9-4726-b326-a0ff5b5f2374-kube-api-access-wbdlr\") pod \"thanos-querier-5f56fcd9d9-22gsp\" (UID: \"358aeabd-5de9-4726-b326-a0ff5b5f2374\") " pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.694629 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.694568 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vdhx2" podStartSLOduration=1.466254772 podStartE2EDuration="3.694548551s" totalImagesPullingTime="2.228293779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:20.692658956 +0000 UTC m=+75.990086306" watchObservedRunningTime="2026-07-09 22:29:20.694548551 +0000 UTC m=+75.991975850" Jul 09 22:29:20.723465 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.723406 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xk96q" podStartSLOduration=1.452005261 podStartE2EDuration="3.72338321s" totalImagesPullingTime="2.271377949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:20.720111965 +0000 UTC m=+76.017539263" watchObservedRunningTime="2026-07-09 22:29:20.72338321 +0000 UTC m=+76.020810509" Jul 09 22:29:20.755985 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.755965 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:20.903357 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:20.903329 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp"] Jul 09 22:29:20.905647 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:20.905617 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358aeabd_5de9_4726_b326_a0ff5b5f2374.slice/crio-1fcaf4023c2982e8d533816f2a49130e3ebedbdb14946fffbdd71bc82c514e6f WatchSource:0}: Error finding container 1fcaf4023c2982e8d533816f2a49130e3ebedbdb14946fffbdd71bc82c514e6f: Status 404 returned error can't find the container with id 1fcaf4023c2982e8d533816f2a49130e3ebedbdb14946fffbdd71bc82c514e6f Jul 09 22:29:21.652772 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.652739 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" event={"ID":"358aeabd-5de9-4726-b326-a0ff5b5f2374","Type":"ContainerStarted","Data":"1fcaf4023c2982e8d533816f2a49130e3ebedbdb14946fffbdd71bc82c514e6f"} Jul 09 22:29:21.654736 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.654708 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9jqr" event={"ID":"c5cef037-6b09-431d-8fca-f5e55ead2078","Type":"ContainerStarted","Data":"977c545b3c03ab5ae6e06ac762580cc599a58381e1b4f5b0311e230d65313913"} Jul 09 22:29:21.654852 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.654750 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9jqr" event={"ID":"c5cef037-6b09-431d-8fca-f5e55ead2078","Type":"ContainerStarted","Data":"39e32c48686da20f8150d64802316623700e222b08e21b902fc2abde3641444b"} Jul 09 22:29:21.656067 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.656043 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerID="88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d" exitCode=0 Jul 09 22:29:21.656158 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.656138 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerDied","Data":"88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d"} Jul 09 22:29:21.692535 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.692394 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n9jqr" podStartSLOduration=2.18201538 podStartE2EDuration="4.692374385s" totalImagesPullingTime="2.389742237s" totalInitContainerRuntime="120.616768ms" isStatefulPod=true podCreationTimestamp="2026-07-09 22:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:21.69106282 +0000 UTC m=+76.988490119" watchObservedRunningTime="2026-07-09 22:29:21.692374385 +0000 UTC m=+76.989801684" Jul 09 22:29:21.864179 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.864141 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4"] Jul 09 22:29:21.866926 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.866885 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:21.870941 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.870765 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 22:29:21.870941 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.870845 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9jptn\"" Jul 09 22:29:21.878851 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.878775 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4"] Jul 09 22:29:21.950722 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.950631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kqvr\" (UniqueName: \"kubernetes.io/projected/c338ceda-f46c-40b6-95d9-ae6a06db0e66-kube-api-access-6kqvr\") pod \"monitoring-plugin-d5dcff7cf-qdvl4\" (UID: \"c338ceda-f46c-40b6-95d9-ae6a06db0e66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:21.950886 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.950756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c338ceda-f46c-40b6-95d9-ae6a06db0e66-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qdvl4\" (UID: \"c338ceda-f46c-40b6-95d9-ae6a06db0e66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:21.978012 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.977975 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7655556945-vsksz"] Jul 09 22:29:21.980266 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.980244 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:21.983425 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.983390 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bk1fspcl2luap\"" Jul 09 22:29:21.988789 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.988766 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 22:29:21.988789 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.988793 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 22:29:21.988789 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.988830 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rjl5q\"" Jul 09 22:29:21.989112 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.989102 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 22:29:21.989419 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.989396 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 22:29:21.999962 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:21.999935 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7655556945-vsksz"] Jul 09 22:29:22.051719 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.051683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-secret-metrics-server-tls\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.051876 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.051757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-secret-metrics-server-client-certs\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.051876 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.051823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-metrics-server-audit-profiles\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.051876 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.051858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c338ceda-f46c-40b6-95d9-ae6a06db0e66-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qdvl4\" (UID: \"c338ceda-f46c-40b6-95d9-ae6a06db0e66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:22.052088 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.051881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-client-ca-bundle\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.052088 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.051897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfcgc\" (UniqueName: \"kubernetes.io/projected/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-kube-api-access-wfcgc\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.052088 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.051943 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.052088 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.051981 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-audit-log\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.052088 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.052003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kqvr\" (UniqueName: \"kubernetes.io/projected/c338ceda-f46c-40b6-95d9-ae6a06db0e66-kube-api-access-6kqvr\") pod \"monitoring-plugin-d5dcff7cf-qdvl4\" (UID: \"c338ceda-f46c-40b6-95d9-ae6a06db0e66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:22.054456 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.054431 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c338ceda-f46c-40b6-95d9-ae6a06db0e66-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qdvl4\" (UID: \"c338ceda-f46c-40b6-95d9-ae6a06db0e66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:22.077387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.077359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kqvr\" (UniqueName: \"kubernetes.io/projected/c338ceda-f46c-40b6-95d9-ae6a06db0e66-kube-api-access-6kqvr\") pod \"monitoring-plugin-d5dcff7cf-qdvl4\" (UID: \"c338ceda-f46c-40b6-95d9-ae6a06db0e66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:22.153007 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.152971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-secret-metrics-server-tls\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.153206 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.153052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-secret-metrics-server-client-certs\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.153206 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.153086 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-metrics-server-audit-profiles\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.153206 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.153129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-client-ca-bundle\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.153206 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.153156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfcgc\" (UniqueName: \"kubernetes.io/projected/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-kube-api-access-wfcgc\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.153206 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.153183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.153455 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.153224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-audit-log\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.153839 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.153812 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-audit-log\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.154428 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.154401 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.154510 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.154478 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-metrics-server-audit-profiles\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.156099 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.156077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-secret-metrics-server-tls\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.156178 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.156165 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-client-ca-bundle\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.156247 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.156183 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-secret-metrics-server-client-certs\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.164505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.164482 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfcgc\" (UniqueName: \"kubernetes.io/projected/7a7f5334-a858-46e7-bc8c-c1d2a29d7180-kube-api-access-wfcgc\") pod \"metrics-server-7655556945-vsksz\" (UID: \"7a7f5334-a858-46e7-bc8c-c1d2a29d7180\") " pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.180371 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.180344 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:22.291590 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.291307 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:22.389679 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.388674 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4"] Jul 09 22:29:22.393421 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:22.393390 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc338ceda_f46c_40b6_95d9_ae6a06db0e66.slice/crio-d1952809cbf38c854bb24669e44f4d35c303fdf9544d363cb30000cf8e0c8292 WatchSource:0}: Error finding container d1952809cbf38c854bb24669e44f4d35c303fdf9544d363cb30000cf8e0c8292: Status 404 returned error can't find the container with id d1952809cbf38c854bb24669e44f4d35c303fdf9544d363cb30000cf8e0c8292 Jul 09 22:29:22.451389 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.451349 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7655556945-vsksz"] Jul 09 22:29:22.454654 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:22.454624 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7f5334_a858_46e7_bc8c_c1d2a29d7180.slice/crio-019daeafd00d948d16a02a580a98112848397ee5444c3293a449235e21c956d0 WatchSource:0}: Error finding container 019daeafd00d948d16a02a580a98112848397ee5444c3293a449235e21c956d0: Status 404 returned error can't find the container with id 019daeafd00d948d16a02a580a98112848397ee5444c3293a449235e21c956d0 Jul 09 22:29:22.512498 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.512346 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bd47c7868-j5hg5"] Jul 09 22:29:22.515312 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.515279 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.530681 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.530645 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bd47c7868-j5hg5"] Jul 09 22:29:22.657387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.657353 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-serving-cert\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.657863 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.657398 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-config\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.657863 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.657418 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-trusted-ca-bundle\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.657863 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.657455 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-oauth-serving-cert\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.657863 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.657591 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-service-ca\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.657863 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.657631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxfgv\" (UniqueName: \"kubernetes.io/projected/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-kube-api-access-xxfgv\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.657863 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.657675 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-oauth-config\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.663214 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.663183 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" event={"ID":"c338ceda-f46c-40b6-95d9-ae6a06db0e66","Type":"ContainerStarted","Data":"d1952809cbf38c854bb24669e44f4d35c303fdf9544d363cb30000cf8e0c8292"} Jul 09 22:29:22.664577 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.664545 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7655556945-vsksz" event={"ID":"7a7f5334-a858-46e7-bc8c-c1d2a29d7180","Type":"ContainerStarted","Data":"019daeafd00d948d16a02a580a98112848397ee5444c3293a449235e21c956d0"} Jul 09 22:29:22.758109 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.758082 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-service-ca\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.758109 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.758117 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxfgv\" (UniqueName: \"kubernetes.io/projected/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-kube-api-access-xxfgv\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.758376 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.758144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-oauth-config\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.758376 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.758192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-serving-cert\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.758376 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.758249 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-config\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.758376 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.758272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-trusted-ca-bundle\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.758376 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.758336 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-oauth-serving-cert\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.759104 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.759057 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-service-ca\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.759627 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.759569 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-config\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.759735 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.759653 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-trusted-ca-bundle\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.759735 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.759721 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-oauth-serving-cert\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.761260 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.761238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-oauth-config\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.761357 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.761245 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-serving-cert\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.767635 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.767572 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxfgv\" (UniqueName: \"kubernetes.io/projected/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-kube-api-access-xxfgv\") pod \"console-6bd47c7868-j5hg5\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:22.828672 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:22.828632 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:23.138034 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.137501 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bd47c7868-j5hg5"] Jul 09 22:29:23.144842 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:23.144771 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9648c0ac_7aea_4b7b_8c7a_cfcb89a4e6c9.slice/crio-0a5eb89cf60a6820b0a5ad3469e878335371796d5a71f793cf53442b1a6eb6ad WatchSource:0}: Error finding container 0a5eb89cf60a6820b0a5ad3469e878335371796d5a71f793cf53442b1a6eb6ad: Status 404 returned error can't find the container with id 0a5eb89cf60a6820b0a5ad3469e878335371796d5a71f793cf53442b1a6eb6ad Jul 09 22:29:23.597720 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.597459 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 22:29:23.603389 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.602662 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.606538 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.606510 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 22:29:23.607367 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.607344 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 22:29:23.608168 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.607968 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 22:29:23.608168 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.607974 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 22:29:23.609232 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.609210 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-24f1d9c442kt6\"" Jul 09 22:29:23.609347 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.609252 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 22:29:23.609535 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.609520 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 22:29:23.609625 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.609594 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 22:29:23.610726 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.609704 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 22:29:23.610726 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.609845 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 22:29:23.610726 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.609889 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 22:29:23.610726 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.609524 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 22:29:23.610726 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.610182 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 22:29:23.610726 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.610257 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p4g24\"" Jul 09 22:29:23.612524 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.612334 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 22:29:23.617408 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.617339 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 22:29:23.642768 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.642711 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 22:29:23.683126 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.683062 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" event={"ID":"358aeabd-5de9-4726-b326-a0ff5b5f2374","Type":"ContainerStarted","Data":"4ea85dacbd3f2159d7e37cbe40989f654c234099fb2be1a0a74d47d6d19689c7"} Jul 09 22:29:23.684202 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.684171 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" event={"ID":"358aeabd-5de9-4726-b326-a0ff5b5f2374","Type":"ContainerStarted","Data":"60c4264d7b2973984ddbda264aa1b0629f0e44ca4dcaf4a4ab9cbe343a16dcc8"} Jul 09 22:29:23.686829 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.686000 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd47c7868-j5hg5" event={"ID":"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9","Type":"ContainerStarted","Data":"57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3"} Jul 09 22:29:23.686829 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.686050 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd47c7868-j5hg5" event={"ID":"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9","Type":"ContainerStarted","Data":"0a5eb89cf60a6820b0a5ad3469e878335371796d5a71f793cf53442b1a6eb6ad"} Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775641 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775664 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775709 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.775854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775802 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.776574 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.775878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.776574 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.776027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.776574 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.776519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.776574 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.776554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.776802 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.776630 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.776802 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.776714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.776907 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.776802 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.776907 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.776833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.776907 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.776878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxcp\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-kube-api-access-9xxcp\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.877845 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.877845 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.877845 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877656 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.877845 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.877845 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877702 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.877845 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.877845 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.877845 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.877845 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxcp\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-kube-api-access-9xxcp\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877865 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.877976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878002 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878139 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878176 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878237 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878342 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.878473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878363 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.879144 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.878546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.879144 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.879009 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.879144 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.879092 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.879596 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.879573 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.880844 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.880813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.881887 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.881597 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.881887 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.881738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.882902 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.882878 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.884111 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.884085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.888070 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.887998 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.888070 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.888043 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.888243 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.888090 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.888999 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.888975 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.889436 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.889391 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.889563 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.889527 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.889757 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.889720 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.890336 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.890123 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.907739 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.907711 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxcp\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-kube-api-access-9xxcp\") pod \"prometheus-k8s-0\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:23.923766 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:23.923578 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:24.806761 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:24.806706 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bd47c7868-j5hg5" podStartSLOduration=2.806687898 podStartE2EDuration="2.806687898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:23.721771314 +0000 UTC m=+79.019198614" watchObservedRunningTime="2026-07-09 22:29:24.806687898 +0000 UTC m=+80.104115196" Jul 09 22:29:24.807264 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:24.807186 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 22:29:24.809804 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:29:24.809772 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed619fb_39fc_4fa9_8788_7797d8e884c7.slice/crio-045fbda9541697a5af59e33d4803d930817a3b2a961c1462771bc9bd2fb62842 WatchSource:0}: Error finding container 045fbda9541697a5af59e33d4803d930817a3b2a961c1462771bc9bd2fb62842: Status 404 returned error can't find the container with id 045fbda9541697a5af59e33d4803d930817a3b2a961c1462771bc9bd2fb62842 Jul 09 22:29:25.698414 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.698263 2567 generic.go:356] "Generic (PLEG): container finished" podID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerID="a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5" exitCode=0 Jul 09 22:29:25.698414 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.698303 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerDied","Data":"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5"} Jul 09 22:29:25.698553 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.698420 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerStarted","Data":"045fbda9541697a5af59e33d4803d930817a3b2a961c1462771bc9bd2fb62842"} Jul 09 22:29:25.702863 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.702810 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerStarted","Data":"22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f"} Jul 09 22:29:25.702998 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.702878 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerStarted","Data":"03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba"} Jul 09 22:29:25.702998 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.702945 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerStarted","Data":"3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a"} Jul 09 22:29:25.702998 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.702974 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerStarted","Data":"245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195"} Jul 09 22:29:25.702998 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.702995 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerStarted","Data":"d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251"} Jul 09 22:29:25.705507 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.705477 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" event={"ID":"358aeabd-5de9-4726-b326-a0ff5b5f2374","Type":"ContainerStarted","Data":"196e0ecece196a6601499df6ef790b880c51f5075bf2bf5103c74524734182c2"} Jul 09 22:29:25.707084 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.707059 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" event={"ID":"c338ceda-f46c-40b6-95d9-ae6a06db0e66","Type":"ContainerStarted","Data":"753983af8440b8be45dc8c56e506df11b0bd7eb7abfe27243586bbeded7ec210"} Jul 09 22:29:25.707209 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.707192 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:25.708797 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.708769 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7655556945-vsksz" event={"ID":"7a7f5334-a858-46e7-bc8c-c1d2a29d7180","Type":"ContainerStarted","Data":"26a215ad48cb4defc3579cfe908ceffe3bbe52f5a2517a6eeecbf00ecbd750c1"} Jul 09 22:29:25.713448 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.713403 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" Jul 09 22:29:25.786335 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.786188 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.061137751 podStartE2EDuration="7.786165853s" totalImagesPullingTime="4.708633624s" totalInitContainerRuntime="16.394478ms" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:25.785290757 +0000 UTC m=+81.082718056" watchObservedRunningTime="2026-07-09 22:29:25.786165853 +0000 UTC m=+81.083593155" Jul 09 22:29:25.813444 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.813396 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qdvl4" podStartSLOduration=2.578580873 podStartE2EDuration="4.813378553s" totalImagesPullingTime="2.23479768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:25.811718744 +0000 UTC m=+81.109146040" watchObservedRunningTime="2026-07-09 22:29:25.813378553 +0000 UTC m=+81.110805851" Jul 09 22:29:25.841356 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:25.840461 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7655556945-vsksz" podStartSLOduration=2.664637107 podStartE2EDuration="4.840439337s" totalImagesPullingTime="2.17580223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:25.839020492 +0000 UTC m=+81.136447791" watchObservedRunningTime="2026-07-09 22:29:25.840439337 +0000 UTC m=+81.137866636" Jul 09 22:29:26.718152 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:26.717999 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerStarted","Data":"ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268"} Jul 09 22:29:26.721495 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:26.721469 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" event={"ID":"358aeabd-5de9-4726-b326-a0ff5b5f2374","Type":"ContainerStarted","Data":"73eefb735d8ba95f5ad5df11648dcc37c2738dddee9830887a0f23c1d17c8434"} Jul 09 22:29:26.721644 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:26.721539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" event={"ID":"358aeabd-5de9-4726-b326-a0ff5b5f2374","Type":"ContainerStarted","Data":"749a473b343d2dec502e781a65f2d76acdd16cbe6f64a1550b7af972819a0b80"} Jul 09 22:29:26.721644 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:26.721571 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" event={"ID":"358aeabd-5de9-4726-b326-a0ff5b5f2374","Type":"ContainerStarted","Data":"6b6b3e68e39f39aec383c2297fc5d71c0c80de465fe6d46a94f69f57c6bae616"} Jul 09 22:29:26.721753 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:26.721688 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:26.751988 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:26.751922 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" podStartSLOduration=3.770337272 podStartE2EDuration="6.751884094s" totalImagesPullingTime="2.981546822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:26.748926873 +0000 UTC m=+82.046354162" watchObservedRunningTime="2026-07-09 22:29:26.751884094 +0000 UTC m=+82.049311392" Jul 09 22:29:29.745083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:29.744980 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerStarted","Data":"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d"} Jul 09 22:29:29.745083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:29.745060 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerStarted","Data":"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22"} Jul 09 22:29:29.745507 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:29.745099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerStarted","Data":"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82"} Jul 09 22:29:29.745507 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:29.745129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerStarted","Data":"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8"} Jul 09 22:29:29.745507 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:29.745154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerStarted","Data":"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39"} Jul 09 22:29:29.745507 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:29.745196 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerStarted","Data":"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5"} Jul 09 22:29:29.815054 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:29.814993 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.346263129 podStartE2EDuration="6.81497771s" totalImagesPullingTime="3.444178109s" totalInitContainerRuntime="24.536472ms" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:29.808365606 +0000 UTC m=+85.105792904" watchObservedRunningTime="2026-07-09 22:29:29.81497771 +0000 UTC m=+85.112405008" Jul 09 22:29:32.737018 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:32.736985 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f56fcd9d9-22gsp" Jul 09 22:29:32.829891 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:32.829855 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:32.830676 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:32.830655 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:32.834423 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:32.834400 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:33.768972 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:33.768944 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:29:33.831599 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:33.831565 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd58c764-pzhp4"] Jul 09 22:29:33.924435 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:33.924402 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:29:42.292459 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:42.292419 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:42.292968 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:42.292484 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:29:45.272463 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.272399 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9fc96df89-fwhrz" podUID="75b27c1c-2968-4dc4-a181-ede9e612af3b" containerName="console" containerID="cri-o://65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e" gracePeriod=15 Jul 09 22:29:45.526475 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.526418 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:45.586540 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.586500 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-oauth-config\") pod \"75b27c1c-2968-4dc4-a181-ede9e612af3b\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " Jul 09 22:29:45.586540 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.586537 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-service-ca\") pod \"75b27c1c-2968-4dc4-a181-ede9e612af3b\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " Jul 09 22:29:45.586783 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.586586 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-serving-cert\") pod \"75b27c1c-2968-4dc4-a181-ede9e612af3b\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " Jul 09 22:29:45.586783 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.586617 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-oauth-serving-cert\") pod \"75b27c1c-2968-4dc4-a181-ede9e612af3b\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " Jul 09 22:29:45.586783 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.586632 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67qsh\" (UniqueName: \"kubernetes.io/projected/75b27c1c-2968-4dc4-a181-ede9e612af3b-kube-api-access-67qsh\") pod \"75b27c1c-2968-4dc4-a181-ede9e612af3b\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " Jul 09 22:29:45.586783 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.586681 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-config\") pod \"75b27c1c-2968-4dc4-a181-ede9e612af3b\" (UID: \"75b27c1c-2968-4dc4-a181-ede9e612af3b\") " Jul 09 22:29:45.587197 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.587119 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "75b27c1c-2968-4dc4-a181-ede9e612af3b" (UID: "75b27c1c-2968-4dc4-a181-ede9e612af3b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:29:45.587197 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.587184 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-config" (OuterVolumeSpecName: "console-config") pod "75b27c1c-2968-4dc4-a181-ede9e612af3b" (UID: "75b27c1c-2968-4dc4-a181-ede9e612af3b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:29:45.587346 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.587291 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-service-ca" (OuterVolumeSpecName: "service-ca") pod "75b27c1c-2968-4dc4-a181-ede9e612af3b" (UID: "75b27c1c-2968-4dc4-a181-ede9e612af3b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:29:45.589078 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.589046 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "75b27c1c-2968-4dc4-a181-ede9e612af3b" (UID: "75b27c1c-2968-4dc4-a181-ede9e612af3b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:29:45.589078 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.589067 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75b27c1c-2968-4dc4-a181-ede9e612af3b-kube-api-access-67qsh" (OuterVolumeSpecName: "kube-api-access-67qsh") pod "75b27c1c-2968-4dc4-a181-ede9e612af3b" (UID: "75b27c1c-2968-4dc4-a181-ede9e612af3b"). InnerVolumeSpecName "kube-api-access-67qsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:29:45.589223 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.589098 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "75b27c1c-2968-4dc4-a181-ede9e612af3b" (UID: "75b27c1c-2968-4dc4-a181-ede9e612af3b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:29:45.688217 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.688184 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:45.688217 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.688214 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-oauth-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:45.688363 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.688224 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-service-ca\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:45.688363 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.688233 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75b27c1c-2968-4dc4-a181-ede9e612af3b-console-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:45.688363 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.688242 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75b27c1c-2968-4dc4-a181-ede9e612af3b-oauth-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:45.688363 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.688250 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67qsh\" (UniqueName: \"kubernetes.io/projected/75b27c1c-2968-4dc4-a181-ede9e612af3b-kube-api-access-67qsh\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:45.813844 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.813811 2567 generic.go:356] "Generic (PLEG): container finished" podID="75b27c1c-2968-4dc4-a181-ede9e612af3b" containerID="65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e" exitCode=0 Jul 09 22:29:45.814027 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.813863 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fc96df89-fwhrz" Jul 09 22:29:45.814027 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.813900 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fc96df89-fwhrz" event={"ID":"75b27c1c-2968-4dc4-a181-ede9e612af3b","Type":"ContainerDied","Data":"65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e"} Jul 09 22:29:45.814027 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.814008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fc96df89-fwhrz" event={"ID":"75b27c1c-2968-4dc4-a181-ede9e612af3b","Type":"ContainerDied","Data":"7370c77f5c6366679a2baeab70f329ffc4705c2dacce381502b092b79754a2eb"} Jul 09 22:29:45.814142 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.814033 2567 scope.go:117] "RemoveContainer" containerID="65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e" Jul 09 22:29:45.823165 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.823142 2567 scope.go:117] "RemoveContainer" containerID="65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e" Jul 09 22:29:45.823430 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:29:45.823410 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e\": container with ID starting with 65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e not found: ID does not exist" containerID="65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e" Jul 09 22:29:45.823494 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.823439 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e"} err="failed to get container status \"65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e\": rpc error: code = NotFound desc = could not find container \"65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e\": container with ID starting with 65c7311e8bfce131bb9f852785f26f75f6fbcff7fff651a662111938a8640d2e not found: ID does not exist" Jul 09 22:29:45.837313 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.837259 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9fc96df89-fwhrz"] Jul 09 22:29:45.838667 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:45.838647 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9fc96df89-fwhrz"] Jul 09 22:29:47.177491 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:47.177457 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75b27c1c-2968-4dc4-a181-ede9e612af3b" path="/var/lib/kubelet/pods/75b27c1c-2968-4dc4-a181-ede9e612af3b/volumes" Jul 09 22:29:48.630295 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:48.630266 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mbrzx" Jul 09 22:29:58.852371 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:58.852326 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cd58c764-pzhp4" podUID="4924659a-e029-43c5-9671-0938e65f6150" containerName="console" containerID="cri-o://6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f" gracePeriod=15 Jul 09 22:29:59.099193 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.099166 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:59.215005 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.214897 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-trusted-ca-bundle\") pod \"4924659a-e029-43c5-9671-0938e65f6150\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " Jul 09 22:29:59.215005 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.214980 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-oauth-serving-cert\") pod \"4924659a-e029-43c5-9671-0938e65f6150\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " Jul 09 22:29:59.215248 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215009 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-service-ca\") pod \"4924659a-e029-43c5-9671-0938e65f6150\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " Jul 09 22:29:59.215248 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215044 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhm45\" (UniqueName: \"kubernetes.io/projected/4924659a-e029-43c5-9671-0938e65f6150-kube-api-access-xhm45\") pod \"4924659a-e029-43c5-9671-0938e65f6150\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " Jul 09 22:29:59.215248 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215074 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-oauth-config\") pod \"4924659a-e029-43c5-9671-0938e65f6150\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " Jul 09 22:29:59.215248 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215222 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-console-config\") pod \"4924659a-e029-43c5-9671-0938e65f6150\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " Jul 09 22:29:59.215436 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215300 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-serving-cert\") pod \"4924659a-e029-43c5-9671-0938e65f6150\" (UID: \"4924659a-e029-43c5-9671-0938e65f6150\") " Jul 09 22:29:59.215485 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215463 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4924659a-e029-43c5-9671-0938e65f6150" (UID: "4924659a-e029-43c5-9671-0938e65f6150"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:29:59.215532 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215472 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4924659a-e029-43c5-9671-0938e65f6150" (UID: "4924659a-e029-43c5-9671-0938e65f6150"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:29:59.215597 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215578 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-service-ca" (OuterVolumeSpecName: "service-ca") pod "4924659a-e029-43c5-9671-0938e65f6150" (UID: "4924659a-e029-43c5-9671-0938e65f6150"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:29:59.215650 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215616 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-oauth-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:59.215650 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215616 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-console-config" (OuterVolumeSpecName: "console-config") pod "4924659a-e029-43c5-9671-0938e65f6150" (UID: "4924659a-e029-43c5-9671-0938e65f6150"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:29:59.215650 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.215634 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-trusted-ca-bundle\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:59.217485 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.217454 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4924659a-e029-43c5-9671-0938e65f6150-kube-api-access-xhm45" (OuterVolumeSpecName: "kube-api-access-xhm45") pod "4924659a-e029-43c5-9671-0938e65f6150" (UID: "4924659a-e029-43c5-9671-0938e65f6150"). InnerVolumeSpecName "kube-api-access-xhm45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:29:59.217485 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.217458 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4924659a-e029-43c5-9671-0938e65f6150" (UID: "4924659a-e029-43c5-9671-0938e65f6150"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:29:59.217671 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.217540 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4924659a-e029-43c5-9671-0938e65f6150" (UID: "4924659a-e029-43c5-9671-0938e65f6150"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:29:59.316128 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.316079 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-service-ca\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:59.316128 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.316123 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhm45\" (UniqueName: \"kubernetes.io/projected/4924659a-e029-43c5-9671-0938e65f6150-kube-api-access-xhm45\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:59.316128 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.316133 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-oauth-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:59.316128 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.316141 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4924659a-e029-43c5-9671-0938e65f6150-console-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:59.316128 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.316150 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4924659a-e029-43c5-9671-0938e65f6150-console-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:29:59.874907 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.874869 2567 generic.go:356] "Generic (PLEG): container finished" podID="4924659a-e029-43c5-9671-0938e65f6150" containerID="6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f" exitCode=0 Jul 09 22:29:59.875409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.874950 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd58c764-pzhp4" Jul 09 22:29:59.875409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.874958 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd58c764-pzhp4" event={"ID":"4924659a-e029-43c5-9671-0938e65f6150","Type":"ContainerDied","Data":"6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f"} Jul 09 22:29:59.875409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.875056 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd58c764-pzhp4" event={"ID":"4924659a-e029-43c5-9671-0938e65f6150","Type":"ContainerDied","Data":"a2a216ddadb4f87232127b731b3301c0a94470e312fc4d757d8ff87151721a95"} Jul 09 22:29:59.875409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.875090 2567 scope.go:117] "RemoveContainer" containerID="6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f" Jul 09 22:29:59.883487 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.883466 2567 scope.go:117] "RemoveContainer" containerID="6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f" Jul 09 22:29:59.883731 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:29:59.883713 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f\": container with ID starting with 6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f not found: ID does not exist" containerID="6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f" Jul 09 22:29:59.883776 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.883739 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f"} err="failed to get container status \"6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f\": rpc error: code = NotFound desc = could not find container \"6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f\": container with ID starting with 6df9eb626a4f8907649e3d11477b606440ed7726d9ed5052a391698ec6e0351f not found: ID does not exist" Jul 09 22:29:59.897757 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.897722 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd58c764-pzhp4"] Jul 09 22:29:59.902578 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:29:59.902555 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cd58c764-pzhp4"] Jul 09 22:30:01.177498 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:01.177464 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4924659a-e029-43c5-9671-0938e65f6150" path="/var/lib/kubelet/pods/4924659a-e029-43c5-9671-0938e65f6150/volumes" Jul 09 22:30:02.297006 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:02.296976 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:30:02.300785 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:02.300766 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7655556945-vsksz" Jul 09 22:30:23.924754 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:23.924712 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:30:23.944042 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:23.944016 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:30:23.991982 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:23.991905 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:30:37.550962 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:37.550925 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 22:30:37.551483 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:37.551228 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="alertmanager" containerID="cri-o://d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251" gracePeriod=120 Jul 09 22:30:37.551483 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:37.551298 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy-metric" containerID="cri-o://22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f" gracePeriod=120 Jul 09 22:30:37.551483 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:37.551336 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="config-reloader" containerID="cri-o://245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195" gracePeriod=120 Jul 09 22:30:37.551483 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:37.551352 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="prom-label-proxy" containerID="cri-o://ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268" gracePeriod=120 Jul 09 22:30:37.551483 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:37.551392 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy" containerID="cri-o://03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba" gracePeriod=120 Jul 09 22:30:37.551483 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:37.551320 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy-web" containerID="cri-o://3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a" gracePeriod=120 Jul 09 22:30:38.038755 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.038726 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerID="ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268" exitCode=0 Jul 09 22:30:38.038755 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.038750 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerID="03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba" exitCode=0 Jul 09 22:30:38.038755 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.038756 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerID="245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195" exitCode=0 Jul 09 22:30:38.038755 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.038761 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerID="d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251" exitCode=0 Jul 09 22:30:38.039027 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.038796 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerDied","Data":"ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268"} Jul 09 22:30:38.039027 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.038858 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerDied","Data":"03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba"} Jul 09 22:30:38.039027 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.038882 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerDied","Data":"245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195"} Jul 09 22:30:38.039027 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.038905 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerDied","Data":"d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251"} Jul 09 22:30:38.807348 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.807322 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:38.858854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.858827 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-tls-assets\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.858854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.858867 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-main-tls\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.859107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.858895 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-cluster-tls-config\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.859107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.859070 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-metrics-client-ca\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.859257 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.859238 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-main-db\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.859423 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.859406 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-web\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.859579 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.859563 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcprv\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-kube-api-access-dcprv\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.859713 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.859699 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.859800 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.859774 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:30:38.859906 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.859890 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-volume\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.860064 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.860048 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-web-config\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.860201 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.860186 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-trusted-ca-bundle\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.860300 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.860287 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-out\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.860431 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.860417 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy\") pod \"f0a53477-40de-4d26-9eb7-9d68f5cde554\" (UID: \"f0a53477-40de-4d26-9eb7-9d68f5cde554\") " Jul 09 22:30:38.860526 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.860498 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:30:38.860811 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.860793 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-metrics-client-ca\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.861266 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.861244 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-main-db\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.861461 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.861434 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:30:38.861548 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.861520 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:30:38.862156 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.862129 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:30:38.864005 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.863906 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-out" (OuterVolumeSpecName: "config-out") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:30:38.864209 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.864186 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:30:38.864406 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.864378 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-kube-api-access-dcprv" (OuterVolumeSpecName: "kube-api-access-dcprv") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "kube-api-access-dcprv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:30:38.864684 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.864652 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:30:38.864873 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.864848 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:30:38.866085 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.866063 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-volume" (OuterVolumeSpecName: "config-volume") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:30:38.867406 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.867386 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:30:38.874157 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.874137 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-web-config" (OuterVolumeSpecName: "web-config") pod "f0a53477-40de-4d26-9eb7-9d68f5cde554" (UID: "f0a53477-40de-4d26-9eb7-9d68f5cde554"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:30:38.962387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962344 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-volume\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962382 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-web-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962392 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a53477-40de-4d26-9eb7-9d68f5cde554-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962402 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0a53477-40de-4d26-9eb7-9d68f5cde554-config-out\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962645 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962413 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962645 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962423 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-tls-assets\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962645 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962431 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-main-tls\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962645 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962440 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-cluster-tls-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962645 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962450 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962645 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962460 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcprv\" (UniqueName: \"kubernetes.io/projected/f0a53477-40de-4d26-9eb7-9d68f5cde554-kube-api-access-dcprv\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:38.962645 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:38.962468 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f0a53477-40de-4d26-9eb7-9d68f5cde554-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:30:39.045723 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.045674 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerID="22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f" exitCode=0 Jul 09 22:30:39.045723 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.045708 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerID="3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a" exitCode=0 Jul 09 22:30:39.045723 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.045708 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerDied","Data":"22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f"} Jul 09 22:30:39.046020 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.045752 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.046020 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.045827 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerDied","Data":"3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a"} Jul 09 22:30:39.046020 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.045870 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0a53477-40de-4d26-9eb7-9d68f5cde554","Type":"ContainerDied","Data":"a747e7ae8ac8135c28ebe1df4cf358d22bcd267b693e6d682c491e2d957d5526"} Jul 09 22:30:39.046020 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.045889 2567 scope.go:117] "RemoveContainer" containerID="ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268" Jul 09 22:30:39.054714 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.054693 2567 scope.go:117] "RemoveContainer" containerID="22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f" Jul 09 22:30:39.062278 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.062258 2567 scope.go:117] "RemoveContainer" containerID="03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba" Jul 09 22:30:39.068898 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.068881 2567 scope.go:117] "RemoveContainer" containerID="3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a" Jul 09 22:30:39.072977 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.072956 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 22:30:39.076231 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.076212 2567 scope.go:117] "RemoveContainer" containerID="245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195" Jul 09 22:30:39.080637 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.080618 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 22:30:39.083748 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.083728 2567 scope.go:117] "RemoveContainer" containerID="d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251" Jul 09 22:30:39.090861 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.090844 2567 scope.go:117] "RemoveContainer" containerID="88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d" Jul 09 22:30:39.097530 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.097513 2567 scope.go:117] "RemoveContainer" containerID="ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268" Jul 09 22:30:39.097793 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:30:39.097775 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268\": container with ID starting with ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268 not found: ID does not exist" containerID="ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268" Jul 09 22:30:39.097844 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.097802 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268"} err="failed to get container status \"ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268\": rpc error: code = NotFound desc = could not find container \"ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268\": container with ID starting with ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268 not found: ID does not exist" Jul 09 22:30:39.097844 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.097821 2567 scope.go:117] "RemoveContainer" containerID="22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f" Jul 09 22:30:39.098087 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:30:39.098070 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f\": container with ID starting with 22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f not found: ID does not exist" containerID="22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f" Jul 09 22:30:39.098147 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.098093 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f"} err="failed to get container status \"22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f\": rpc error: code = NotFound desc = could not find container \"22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f\": container with ID starting with 22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f not found: ID does not exist" Jul 09 22:30:39.098147 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.098114 2567 scope.go:117] "RemoveContainer" containerID="03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba" Jul 09 22:30:39.098344 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:30:39.098329 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba\": container with ID starting with 03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba not found: ID does not exist" containerID="03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba" Jul 09 22:30:39.098384 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.098347 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba"} err="failed to get container status \"03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba\": rpc error: code = NotFound desc = could not find container \"03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba\": container with ID starting with 03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba not found: ID does not exist" Jul 09 22:30:39.098384 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.098364 2567 scope.go:117] "RemoveContainer" containerID="3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a" Jul 09 22:30:39.098570 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:30:39.098557 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a\": container with ID starting with 3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a not found: ID does not exist" containerID="3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a" Jul 09 22:30:39.098609 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.098573 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a"} err="failed to get container status \"3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a\": rpc error: code = NotFound desc = could not find container \"3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a\": container with ID starting with 3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a not found: ID does not exist" Jul 09 22:30:39.098609 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.098584 2567 scope.go:117] "RemoveContainer" containerID="245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195" Jul 09 22:30:39.098782 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:30:39.098768 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195\": container with ID starting with 245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195 not found: ID does not exist" containerID="245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195" Jul 09 22:30:39.098820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.098783 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195"} err="failed to get container status \"245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195\": rpc error: code = NotFound desc = could not find container \"245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195\": container with ID starting with 245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195 not found: ID does not exist" Jul 09 22:30:39.098820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.098794 2567 scope.go:117] "RemoveContainer" containerID="d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251" Jul 09 22:30:39.099035 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:30:39.099013 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251\": container with ID starting with d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251 not found: ID does not exist" containerID="d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251" Jul 09 22:30:39.099098 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099041 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251"} err="failed to get container status \"d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251\": rpc error: code = NotFound desc = could not find container \"d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251\": container with ID starting with d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251 not found: ID does not exist" Jul 09 22:30:39.099098 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099056 2567 scope.go:117] "RemoveContainer" containerID="88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d" Jul 09 22:30:39.099292 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:30:39.099276 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d\": container with ID starting with 88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d not found: ID does not exist" containerID="88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d" Jul 09 22:30:39.099338 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099294 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d"} err="failed to get container status \"88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d\": rpc error: code = NotFound desc = could not find container \"88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d\": container with ID starting with 88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d not found: ID does not exist" Jul 09 22:30:39.099338 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099306 2567 scope.go:117] "RemoveContainer" containerID="ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268" Jul 09 22:30:39.099528 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099510 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268"} err="failed to get container status \"ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268\": rpc error: code = NotFound desc = could not find container \"ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268\": container with ID starting with ebd2db35266a98de0b0a4027ef16c0dfbf81210b0f905a6a64ecd30bf9881268 not found: ID does not exist" Jul 09 22:30:39.099568 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099529 2567 scope.go:117] "RemoveContainer" containerID="22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f" Jul 09 22:30:39.099729 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099709 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f"} err="failed to get container status \"22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f\": rpc error: code = NotFound desc = could not find container \"22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f\": container with ID starting with 22ecd14df9da898f3ecb5d70c6f3f307fec4960f81152ac0c1a18b66e5635f8f not found: ID does not exist" Jul 09 22:30:39.099779 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099729 2567 scope.go:117] "RemoveContainer" containerID="03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba" Jul 09 22:30:39.099932 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099901 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba"} err="failed to get container status \"03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba\": rpc error: code = NotFound desc = could not find container \"03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba\": container with ID starting with 03c1f66834c47b366eced633d0da9e56414645607e44a042594ebb314a2fd9ba not found: ID does not exist" Jul 09 22:30:39.099977 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.099933 2567 scope.go:117] "RemoveContainer" containerID="3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a" Jul 09 22:30:39.100135 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.100120 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a"} err="failed to get container status \"3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a\": rpc error: code = NotFound desc = could not find container \"3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a\": container with ID starting with 3b2494c72bba247ceb97f160feb0e818e31c8d7f6a0d11340c20f3a13006558a not found: ID does not exist" Jul 09 22:30:39.100179 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.100135 2567 scope.go:117] "RemoveContainer" containerID="245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195" Jul 09 22:30:39.100359 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.100342 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195"} err="failed to get container status \"245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195\": rpc error: code = NotFound desc = could not find container \"245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195\": container with ID starting with 245665b7378bee8de625a489fb06eecc4e30fffc5723a1a6bef2f8441c008195 not found: ID does not exist" Jul 09 22:30:39.100415 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.100360 2567 scope.go:117] "RemoveContainer" containerID="d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251" Jul 09 22:30:39.100558 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.100542 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251"} err="failed to get container status \"d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251\": rpc error: code = NotFound desc = could not find container \"d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251\": container with ID starting with d7a7bb8a7105478750617e8c43b4fba0cea9c3ab0c36b6f6aa90df2265f45251 not found: ID does not exist" Jul 09 22:30:39.100558 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.100557 2567 scope.go:117] "RemoveContainer" containerID="88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d" Jul 09 22:30:39.100749 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.100732 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d"} err="failed to get container status \"88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d\": rpc error: code = NotFound desc = could not find container \"88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d\": container with ID starting with 88077f876f1db3b242790fd830a3ef3a65485731db7cb0b3dd7d53845d1fa18d not found: ID does not exist" Jul 09 22:30:39.119125 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119051 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 22:30:39.119368 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119356 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy-web" Jul 09 22:30:39.119409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119370 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy-web" Jul 09 22:30:39.119409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119381 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy" Jul 09 22:30:39.119409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119387 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy" Jul 09 22:30:39.119409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119394 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="prom-label-proxy" Jul 09 22:30:39.119409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119400 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="prom-label-proxy" Jul 09 22:30:39.119409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119407 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75b27c1c-2968-4dc4-a181-ede9e612af3b" containerName="console" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119413 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="75b27c1c-2968-4dc4-a181-ede9e612af3b" containerName="console" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119421 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="init-config-reloader" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119427 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="init-config-reloader" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119433 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="alertmanager" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119439 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="alertmanager" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119454 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="config-reloader" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119459 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="config-reloader" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119467 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy-metric" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119471 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy-metric" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119478 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4924659a-e029-43c5-9671-0938e65f6150" containerName="console" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119483 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4924659a-e029-43c5-9671-0938e65f6150" containerName="console" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119526 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy-metric" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119534 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="alertmanager" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119541 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119547 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4924659a-e029-43c5-9671-0938e65f6150" containerName="console" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119552 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="config-reloader" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119557 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="kube-rbac-proxy-web" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119562 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="75b27c1c-2968-4dc4-a181-ede9e612af3b" containerName="console" Jul 09 22:30:39.119585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.119568 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" containerName="prom-label-proxy" Jul 09 22:30:39.126267 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.126241 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.129805 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.129775 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 22:30:39.131340 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.131324 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 22:30:39.131424 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.131354 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 22:30:39.131655 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.131639 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 22:30:39.131870 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.131851 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8r8ks\"" Jul 09 22:30:39.132527 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.132504 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 22:30:39.132623 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.132574 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 22:30:39.132623 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.132575 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 22:30:39.132742 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.132576 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 22:30:39.138961 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.138942 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 22:30:39.148498 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.148474 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 22:30:39.177622 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.177589 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0a53477-40de-4d26-9eb7-9d68f5cde554" path="/var/lib/kubelet/pods/f0a53477-40de-4d26-9eb7-9d68f5cde554/volumes" Jul 09 22:30:39.264601 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.264561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e0df2c47-8cc1-450b-a678-795671664f32-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.264601 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.264608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0df2c47-8cc1-450b-a678-795671664f32-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.264881 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.264630 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.264881 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.264719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0df2c47-8cc1-450b-a678-795671664f32-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.264881 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.264757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0df2c47-8cc1-450b-a678-795671664f32-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.264881 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.264797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.264881 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.264863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.265201 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.264892 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.265201 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.264976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-config-volume\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.265201 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.265003 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8lg8\" (UniqueName: \"kubernetes.io/projected/e0df2c47-8cc1-450b-a678-795671664f32-kube-api-access-x8lg8\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.265201 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.265037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0df2c47-8cc1-450b-a678-795671664f32-config-out\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.265201 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.265101 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.265201 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.265127 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-web-config\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.365827 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.365780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.365827 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.365831 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.365859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-config-volume\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.365874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8lg8\" (UniqueName: \"kubernetes.io/projected/e0df2c47-8cc1-450b-a678-795671664f32-kube-api-access-x8lg8\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.365897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0df2c47-8cc1-450b-a678-795671664f32-config-out\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.365934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.365949 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-web-config\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.365965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e0df2c47-8cc1-450b-a678-795671664f32-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.365988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0df2c47-8cc1-450b-a678-795671664f32-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366481 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.366460 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e0df2c47-8cc1-450b-a678-795671664f32-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366544 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.366522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366599 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.366573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0df2c47-8cc1-450b-a678-795671664f32-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366651 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.366605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0df2c47-8cc1-450b-a678-795671664f32-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.366707 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.366656 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.368970 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.368902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0df2c47-8cc1-450b-a678-795671664f32-config-out\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.368970 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.368943 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0df2c47-8cc1-450b-a678-795671664f32-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.369275 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.369110 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-config-volume\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.369275 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.369237 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.369364 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.369319 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.369412 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.369366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.369535 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.369514 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0df2c47-8cc1-450b-a678-795671664f32-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.369635 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.369615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0df2c47-8cc1-450b-a678-795671664f32-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.369711 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.369698 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-web-config\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.370433 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.370415 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.370574 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.370560 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e0df2c47-8cc1-450b-a678-795671664f32-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.380660 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.380639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8lg8\" (UniqueName: \"kubernetes.io/projected/e0df2c47-8cc1-450b-a678-795671664f32-kube-api-access-x8lg8\") pod \"alertmanager-main-0\" (UID: \"e0df2c47-8cc1-450b-a678-795671664f32\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.436759 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.436721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 22:30:39.586531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:39.586498 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 22:30:39.589519 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:30:39.589495 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0df2c47_8cc1_450b_a678_795671664f32.slice/crio-b136b7cb248e14f61461b15607b55281b5fb030c3d5b1799024dd377643563e8 WatchSource:0}: Error finding container b136b7cb248e14f61461b15607b55281b5fb030c3d5b1799024dd377643563e8: Status 404 returned error can't find the container with id b136b7cb248e14f61461b15607b55281b5fb030c3d5b1799024dd377643563e8 Jul 09 22:30:40.051583 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:40.051546 2567 generic.go:356] "Generic (PLEG): container finished" podID="e0df2c47-8cc1-450b-a678-795671664f32" containerID="d19ee63c4823a7e3d9b514925ca0f554177d0cef14b65130e329344979c0564a" exitCode=0 Jul 09 22:30:40.052022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:40.051629 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0df2c47-8cc1-450b-a678-795671664f32","Type":"ContainerDied","Data":"d19ee63c4823a7e3d9b514925ca0f554177d0cef14b65130e329344979c0564a"} Jul 09 22:30:40.052022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:40.051695 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0df2c47-8cc1-450b-a678-795671664f32","Type":"ContainerStarted","Data":"b136b7cb248e14f61461b15607b55281b5fb030c3d5b1799024dd377643563e8"} Jul 09 22:30:41.060444 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.060410 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0df2c47-8cc1-450b-a678-795671664f32","Type":"ContainerStarted","Data":"454d69b2a275d5d248421913301ae04c9c918e4fbafc858122814a059bd670a3"} Jul 09 22:30:41.060836 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.060503 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0df2c47-8cc1-450b-a678-795671664f32","Type":"ContainerStarted","Data":"52d423a2d0dd0af8d1e32e59d77f94ed4039e9dae737de1a797d172eefb6b5aa"} Jul 09 22:30:41.060836 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.060531 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0df2c47-8cc1-450b-a678-795671664f32","Type":"ContainerStarted","Data":"0f04d6176abf456222f8a954c0a90b0e3c58added03ac91534a476d64d0ad81e"} Jul 09 22:30:41.060836 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.060561 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0df2c47-8cc1-450b-a678-795671664f32","Type":"ContainerStarted","Data":"8dd6fec2ba6182b56a511e059d552db753fe0c63b026265d1b29a7000312ea3b"} Jul 09 22:30:41.060836 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.060584 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0df2c47-8cc1-450b-a678-795671664f32","Type":"ContainerStarted","Data":"abcd6ed3e6f25fdcc463b0015a3e6ca03cf83da1058eecd195c068f890d9ee12"} Jul 09 22:30:41.060836 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.060607 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0df2c47-8cc1-450b-a678-795671664f32","Type":"ContainerStarted","Data":"679f7d2c17f10bd0f7155cb1f095a614490705dbed49e0a02c9b1a3630a2824f"} Jul 09 22:30:41.090963 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.090791 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.072240717 podStartE2EDuration="2.090765546s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.524829ms" isStatefulPod=false podCreationTimestamp="2026-07-09 22:30:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:30:41.089009487 +0000 UTC m=+156.386436785" watchObservedRunningTime="2026-07-09 22:30:41.090765546 +0000 UTC m=+156.388192845" Jul 09 22:30:41.600607 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.600575 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74c9d84899-xzvlk"] Jul 09 22:30:41.604239 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.604213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.607372 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.607347 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 22:30:41.607476 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.607400 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cnx4t\"" Jul 09 22:30:41.608705 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.608680 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 22:30:41.608785 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.608741 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 22:30:41.609594 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.609577 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 22:30:41.609756 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.609740 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 22:30:41.618179 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.618158 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 22:30:41.623715 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.623685 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74c9d84899-xzvlk"] Jul 09 22:30:41.687874 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.687830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-secret-telemeter-client\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.687874 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.687875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcnlv\" (UniqueName: \"kubernetes.io/projected/cafe90cc-1b15-40e4-91c8-3e099f4bd466-kube-api-access-jcnlv\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.688117 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.687940 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cafe90cc-1b15-40e4-91c8-3e099f4bd466-serving-certs-ca-bundle\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.688117 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.687959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-federate-client-tls\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.688117 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.687974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cafe90cc-1b15-40e4-91c8-3e099f4bd466-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.688117 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.688000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-telemeter-client-tls\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.688117 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.688071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.688117 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.688100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cafe90cc-1b15-40e4-91c8-3e099f4bd466-metrics-client-ca\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.789179 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.789138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.789179 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.789178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cafe90cc-1b15-40e4-91c8-3e099f4bd466-metrics-client-ca\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.789429 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.789234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-secret-telemeter-client\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.789429 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.789265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcnlv\" (UniqueName: \"kubernetes.io/projected/cafe90cc-1b15-40e4-91c8-3e099f4bd466-kube-api-access-jcnlv\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.789429 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.789306 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cafe90cc-1b15-40e4-91c8-3e099f4bd466-serving-certs-ca-bundle\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.789429 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.789332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-federate-client-tls\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.789429 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.789350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cafe90cc-1b15-40e4-91c8-3e099f4bd466-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.789429 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.789377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-telemeter-client-tls\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.790143 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.790113 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cafe90cc-1b15-40e4-91c8-3e099f4bd466-metrics-client-ca\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.790308 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.790279 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cafe90cc-1b15-40e4-91c8-3e099f4bd466-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.790378 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.790354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cafe90cc-1b15-40e4-91c8-3e099f4bd466-serving-certs-ca-bundle\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.791951 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.791926 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-federate-client-tls\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.792055 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.792005 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-telemeter-client-tls\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.792150 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.792132 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.792211 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.792171 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cafe90cc-1b15-40e4-91c8-3e099f4bd466-secret-telemeter-client\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.807927 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.807893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcnlv\" (UniqueName: \"kubernetes.io/projected/cafe90cc-1b15-40e4-91c8-3e099f4bd466-kube-api-access-jcnlv\") pod \"telemeter-client-74c9d84899-xzvlk\" (UID: \"cafe90cc-1b15-40e4-91c8-3e099f4bd466\") " pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:41.916552 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:41.916455 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" Jul 09 22:30:42.055314 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:42.055284 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74c9d84899-xzvlk"] Jul 09 22:30:42.058404 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:30:42.058372 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcafe90cc_1b15_40e4_91c8_3e099f4bd466.slice/crio-a457c2fce9210170b6d0209671fb1448559f4257a6008d938e1b0db38fb9b815 WatchSource:0}: Error finding container a457c2fce9210170b6d0209671fb1448559f4257a6008d938e1b0db38fb9b815: Status 404 returned error can't find the container with id a457c2fce9210170b6d0209671fb1448559f4257a6008d938e1b0db38fb9b815 Jul 09 22:30:42.065218 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:42.065188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" event={"ID":"cafe90cc-1b15-40e4-91c8-3e099f4bd466","Type":"ContainerStarted","Data":"a457c2fce9210170b6d0209671fb1448559f4257a6008d938e1b0db38fb9b815"} Jul 09 22:30:45.079665 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:45.079628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" event={"ID":"cafe90cc-1b15-40e4-91c8-3e099f4bd466","Type":"ContainerStarted","Data":"2fa372f7165e87154140a3ceb772eb9aea346dbf106c8f7a6ed6988fee38051d"} Jul 09 22:30:45.080177 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:45.079685 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" event={"ID":"cafe90cc-1b15-40e4-91c8-3e099f4bd466","Type":"ContainerStarted","Data":"0b8a138c4711e37de7aa352b6e08923c53b668ac37004b32304c05187a90865f"} Jul 09 22:30:45.080177 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:45.079705 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" event={"ID":"cafe90cc-1b15-40e4-91c8-3e099f4bd466","Type":"ContainerStarted","Data":"f6e0f85245221ffc3dc04504643db130c34ac2f8f84485a404fd68ed9038498e"} Jul 09 22:30:45.114622 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:45.114555 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74c9d84899-xzvlk" podStartSLOduration=2.137887042 podStartE2EDuration="4.114538657s" totalImagesPullingTime="1.976651615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:30:45.114078031 +0000 UTC m=+160.411505328" watchObservedRunningTime="2026-07-09 22:30:45.114538657 +0000 UTC m=+160.411965954" Jul 09 22:30:45.903559 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:45.903516 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5677454c8b-kf8gz"] Jul 09 22:30:45.907394 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:45.907363 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:45.922628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:45.922591 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5677454c8b-kf8gz"] Jul 09 22:30:46.033083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.032986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-serving-cert\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.033083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.033029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-trusted-ca-bundle\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.033083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.033059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-oauth-config\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.033356 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.033115 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r44gf\" (UniqueName: \"kubernetes.io/projected/cd3ac3de-4261-49fc-88bd-48cffd210c9a-kube-api-access-r44gf\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.033356 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.033238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-oauth-serving-cert\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.033356 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.033286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-service-ca\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.033461 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.033357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-config\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.134720 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.134681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-oauth-serving-cert\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135251 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.134751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-service-ca\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135251 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.134795 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-config\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135251 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.134842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-serving-cert\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135251 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.134868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-trusted-ca-bundle\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135251 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.134898 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-oauth-config\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135251 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.134946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r44gf\" (UniqueName: \"kubernetes.io/projected/cd3ac3de-4261-49fc-88bd-48cffd210c9a-kube-api-access-r44gf\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135648 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.135624 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-oauth-serving-cert\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135792 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.135762 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-service-ca\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135870 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.135787 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-config\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.135955 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.135905 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-trusted-ca-bundle\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.137425 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.137403 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-oauth-config\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.137528 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.137508 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-serving-cert\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.144013 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.143986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r44gf\" (UniqueName: \"kubernetes.io/projected/cd3ac3de-4261-49fc-88bd-48cffd210c9a-kube-api-access-r44gf\") pod \"console-5677454c8b-kf8gz\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.218712 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.218670 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:46.353175 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:46.353144 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5677454c8b-kf8gz"] Jul 09 22:30:46.357177 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:30:46.357150 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3ac3de_4261_49fc_88bd_48cffd210c9a.slice/crio-456d4a8d50122907c1605805fcb8ae1daa002989a3339d1170acd348f30a2c81 WatchSource:0}: Error finding container 456d4a8d50122907c1605805fcb8ae1daa002989a3339d1170acd348f30a2c81: Status 404 returned error can't find the container with id 456d4a8d50122907c1605805fcb8ae1daa002989a3339d1170acd348f30a2c81 Jul 09 22:30:47.092141 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:47.092097 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5677454c8b-kf8gz" event={"ID":"cd3ac3de-4261-49fc-88bd-48cffd210c9a","Type":"ContainerStarted","Data":"47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54"} Jul 09 22:30:47.092363 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:47.092199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5677454c8b-kf8gz" event={"ID":"cd3ac3de-4261-49fc-88bd-48cffd210c9a","Type":"ContainerStarted","Data":"456d4a8d50122907c1605805fcb8ae1daa002989a3339d1170acd348f30a2c81"} Jul 09 22:30:47.115497 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:47.115450 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5677454c8b-kf8gz" podStartSLOduration=2.115433464 podStartE2EDuration="2.115433464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:30:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:30:47.114702432 +0000 UTC m=+162.412129730" watchObservedRunningTime="2026-07-09 22:30:47.115433464 +0000 UTC m=+162.412860761" Jul 09 22:30:56.219002 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:56.218937 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:56.219400 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:56.219029 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:56.223740 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:56.223715 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:57.137577 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:57.137548 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:30:57.199980 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:30:57.199943 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bd47c7868-j5hg5"] Jul 09 22:31:00.417459 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.417425 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 22:31:00.418227 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.418196 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="prometheus" containerID="cri-o://ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" gracePeriod=600 Jul 09 22:31:00.418365 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.418230 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" gracePeriod=600 Jul 09 22:31:00.418365 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.418283 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy" containerID="cri-o://0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" gracePeriod=600 Jul 09 22:31:00.418365 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.418355 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="config-reloader" containerID="cri-o://74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" gracePeriod=600 Jul 09 22:31:00.418528 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.418385 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="thanos-sidecar" containerID="cri-o://b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" gracePeriod=600 Jul 09 22:31:00.418528 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.418246 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy-web" containerID="cri-o://0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" gracePeriod=600 Jul 09 22:31:00.679745 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.679675 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:00.772305 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772272 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-tls\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772305 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772318 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772352 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-metrics-client-certs\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772369 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-web-config\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772390 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772412 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-metrics-client-ca\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772437 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xxcp\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-kube-api-access-9xxcp\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772475 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-kube-rbac-proxy\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772497 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-grpc-tls\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772530 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-1\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772555 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-kubelet-serving-ca-bundle\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772581 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-2\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772631 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-serving-certs-ca-bundle\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772669 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-db\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772695 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-thanos-prometheus-http-client-file\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772757 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-tls-assets\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772787 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-0\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772847 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config-out\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772870 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.772956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772897 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-trusted-ca-bundle\") pod \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\" (UID: \"1ed619fb-39fc-4fa9-8788-7797d8e884c7\") " Jul 09 22:31:00.773447 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.772968 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:00.773447 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.773244 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-metrics-client-ca\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.773447 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.773308 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:00.773447 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.773348 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:00.773653 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.773548 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:00.774558 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.774528 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:00.775760 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.775710 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:31:00.776150 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.776121 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:00.776243 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.776219 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:00.776576 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.776554 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:00.776694 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.776579 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:00.776694 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.776643 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:00.776694 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.776661 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:00.776888 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.776698 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:00.777735 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.777705 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:00.778343 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.778306 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config" (OuterVolumeSpecName: "config") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:00.778429 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.778404 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:00.778527 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.778501 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config-out" (OuterVolumeSpecName: "config-out") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:31:00.778564 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.778523 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:31:00.778805 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.778786 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-kube-api-access-9xxcp" (OuterVolumeSpecName: "kube-api-access-9xxcp") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "kube-api-access-9xxcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:31:00.787868 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.787835 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-web-config" (OuterVolumeSpecName: "web-config") pod "1ed619fb-39fc-4fa9-8788-7797d8e884c7" (UID: "1ed619fb-39fc-4fa9-8788-7797d8e884c7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:00.874594 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874557 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874594 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874589 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-db\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874606 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874619 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-tls-assets\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874630 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874641 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config-out\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874654 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874665 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874677 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874689 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874702 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-metrics-client-certs\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874713 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-web-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874725 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874737 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xxcp\" (UniqueName: \"kubernetes.io/projected/1ed619fb-39fc-4fa9-8788-7797d8e884c7-kube-api-access-9xxcp\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874748 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-kube-rbac-proxy\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874759 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ed619fb-39fc-4fa9-8788-7797d8e884c7-secret-grpc-tls\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874771 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874783 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:00.874833 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:00.874797 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ed619fb-39fc-4fa9-8788-7797d8e884c7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:01.153146 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153112 2567 generic.go:356] "Generic (PLEG): container finished" podID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerID="1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" exitCode=0 Jul 09 22:31:01.153146 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153139 2567 generic.go:356] "Generic (PLEG): container finished" podID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerID="0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" exitCode=0 Jul 09 22:31:01.153146 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153147 2567 generic.go:356] "Generic (PLEG): container finished" podID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerID="0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" exitCode=0 Jul 09 22:31:01.153146 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153153 2567 generic.go:356] "Generic (PLEG): container finished" podID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerID="b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" exitCode=0 Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153160 2567 generic.go:356] "Generic (PLEG): container finished" podID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerID="74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" exitCode=0 Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153168 2567 generic.go:356] "Generic (PLEG): container finished" podID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerID="ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" exitCode=0 Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153198 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153194 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerDied","Data":"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d"} Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerDied","Data":"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22"} Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153326 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerDied","Data":"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82"} Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153352 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerDied","Data":"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8"} Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153371 2567 scope.go:117] "RemoveContainer" containerID="1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153375 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerDied","Data":"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39"} Jul 09 22:31:01.153469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerDied","Data":"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5"} Jul 09 22:31:01.153847 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.153492 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ed619fb-39fc-4fa9-8788-7797d8e884c7","Type":"ContainerDied","Data":"045fbda9541697a5af59e33d4803d930817a3b2a961c1462771bc9bd2fb62842"} Jul 09 22:31:01.162203 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.162183 2567 scope.go:117] "RemoveContainer" containerID="0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" Jul 09 22:31:01.170431 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.170410 2567 scope.go:117] "RemoveContainer" containerID="0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" Jul 09 22:31:01.178796 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.178770 2567 scope.go:117] "RemoveContainer" containerID="b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" Jul 09 22:31:01.180574 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.180552 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 22:31:01.186795 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.186766 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 22:31:01.187662 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.187643 2567 scope.go:117] "RemoveContainer" containerID="74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" Jul 09 22:31:01.195740 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.195721 2567 scope.go:117] "RemoveContainer" containerID="ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" Jul 09 22:31:01.203725 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.203705 2567 scope.go:117] "RemoveContainer" containerID="a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5" Jul 09 22:31:01.212854 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.212833 2567 scope.go:117] "RemoveContainer" containerID="1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" Jul 09 22:31:01.213435 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:31:01.213407 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": container with ID starting with 1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d not found: ID does not exist" containerID="1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" Jul 09 22:31:01.213540 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.213445 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d"} err="failed to get container status \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": rpc error: code = NotFound desc = could not find container \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": container with ID starting with 1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d not found: ID does not exist" Jul 09 22:31:01.213540 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.213472 2567 scope.go:117] "RemoveContainer" containerID="0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" Jul 09 22:31:01.213792 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:31:01.213768 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": container with ID starting with 0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22 not found: ID does not exist" containerID="0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" Jul 09 22:31:01.213839 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.213799 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22"} err="failed to get container status \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": rpc error: code = NotFound desc = could not find container \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": container with ID starting with 0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22 not found: ID does not exist" Jul 09 22:31:01.213839 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.213817 2567 scope.go:117] "RemoveContainer" containerID="0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" Jul 09 22:31:01.214122 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:31:01.214107 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": container with ID starting with 0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82 not found: ID does not exist" containerID="0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" Jul 09 22:31:01.214200 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.214125 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82"} err="failed to get container status \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": rpc error: code = NotFound desc = could not find container \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": container with ID starting with 0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82 not found: ID does not exist" Jul 09 22:31:01.214200 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.214140 2567 scope.go:117] "RemoveContainer" containerID="b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" Jul 09 22:31:01.214381 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:31:01.214367 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": container with ID starting with b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8 not found: ID does not exist" containerID="b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" Jul 09 22:31:01.214421 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.214383 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8"} err="failed to get container status \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": rpc error: code = NotFound desc = could not find container \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": container with ID starting with b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8 not found: ID does not exist" Jul 09 22:31:01.214421 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.214394 2567 scope.go:117] "RemoveContainer" containerID="74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" Jul 09 22:31:01.214608 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:31:01.214592 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": container with ID starting with 74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39 not found: ID does not exist" containerID="74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" Jul 09 22:31:01.214644 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.214614 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39"} err="failed to get container status \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": rpc error: code = NotFound desc = could not find container \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": container with ID starting with 74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39 not found: ID does not exist" Jul 09 22:31:01.214644 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.214628 2567 scope.go:117] "RemoveContainer" containerID="ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" Jul 09 22:31:01.214847 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:31:01.214831 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": container with ID starting with ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5 not found: ID does not exist" containerID="ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" Jul 09 22:31:01.214934 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.214849 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5"} err="failed to get container status \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": rpc error: code = NotFound desc = could not find container \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": container with ID starting with ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5 not found: ID does not exist" Jul 09 22:31:01.214934 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.214863 2567 scope.go:117] "RemoveContainer" containerID="a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5" Jul 09 22:31:01.215100 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:31:01.215083 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": container with ID starting with a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5 not found: ID does not exist" containerID="a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5" Jul 09 22:31:01.215136 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215102 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5"} err="failed to get container status \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": rpc error: code = NotFound desc = could not find container \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": container with ID starting with a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5 not found: ID does not exist" Jul 09 22:31:01.215136 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215116 2567 scope.go:117] "RemoveContainer" containerID="1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" Jul 09 22:31:01.215342 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215320 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d"} err="failed to get container status \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": rpc error: code = NotFound desc = could not find container \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": container with ID starting with 1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d not found: ID does not exist" Jul 09 22:31:01.215388 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215342 2567 scope.go:117] "RemoveContainer" containerID="0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" Jul 09 22:31:01.215549 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215530 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22"} err="failed to get container status \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": rpc error: code = NotFound desc = could not find container \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": container with ID starting with 0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22 not found: ID does not exist" Jul 09 22:31:01.215591 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215549 2567 scope.go:117] "RemoveContainer" containerID="0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" Jul 09 22:31:01.215737 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215722 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82"} err="failed to get container status \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": rpc error: code = NotFound desc = could not find container \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": container with ID starting with 0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82 not found: ID does not exist" Jul 09 22:31:01.215782 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215738 2567 scope.go:117] "RemoveContainer" containerID="b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" Jul 09 22:31:01.215969 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215952 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8"} err="failed to get container status \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": rpc error: code = NotFound desc = could not find container \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": container with ID starting with b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8 not found: ID does not exist" Jul 09 22:31:01.216019 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.215970 2567 scope.go:117] "RemoveContainer" containerID="74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" Jul 09 22:31:01.216160 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216144 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39"} err="failed to get container status \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": rpc error: code = NotFound desc = could not find container \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": container with ID starting with 74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39 not found: ID does not exist" Jul 09 22:31:01.216200 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216160 2567 scope.go:117] "RemoveContainer" containerID="ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" Jul 09 22:31:01.216341 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216324 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5"} err="failed to get container status \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": rpc error: code = NotFound desc = could not find container \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": container with ID starting with ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5 not found: ID does not exist" Jul 09 22:31:01.216377 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216342 2567 scope.go:117] "RemoveContainer" containerID="a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5" Jul 09 22:31:01.216549 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216532 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5"} err="failed to get container status \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": rpc error: code = NotFound desc = could not find container \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": container with ID starting with a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5 not found: ID does not exist" Jul 09 22:31:01.216600 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216549 2567 scope.go:117] "RemoveContainer" containerID="1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" Jul 09 22:31:01.216737 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216723 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d"} err="failed to get container status \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": rpc error: code = NotFound desc = could not find container \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": container with ID starting with 1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d not found: ID does not exist" Jul 09 22:31:01.216775 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216737 2567 scope.go:117] "RemoveContainer" containerID="0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" Jul 09 22:31:01.216901 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216886 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22"} err="failed to get container status \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": rpc error: code = NotFound desc = could not find container \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": container with ID starting with 0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22 not found: ID does not exist" Jul 09 22:31:01.216974 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.216902 2567 scope.go:117] "RemoveContainer" containerID="0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" Jul 09 22:31:01.217140 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.217122 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82"} err="failed to get container status \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": rpc error: code = NotFound desc = could not find container \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": container with ID starting with 0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82 not found: ID does not exist" Jul 09 22:31:01.217180 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.217141 2567 scope.go:117] "RemoveContainer" containerID="b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" Jul 09 22:31:01.217377 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.217351 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8"} err="failed to get container status \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": rpc error: code = NotFound desc = could not find container \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": container with ID starting with b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8 not found: ID does not exist" Jul 09 22:31:01.217377 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.217376 2567 scope.go:117] "RemoveContainer" containerID="74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" Jul 09 22:31:01.217591 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.217576 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39"} err="failed to get container status \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": rpc error: code = NotFound desc = could not find container \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": container with ID starting with 74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39 not found: ID does not exist" Jul 09 22:31:01.217682 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.217592 2567 scope.go:117] "RemoveContainer" containerID="ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" Jul 09 22:31:01.217790 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.217774 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5"} err="failed to get container status \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": rpc error: code = NotFound desc = could not find container \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": container with ID starting with ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5 not found: ID does not exist" Jul 09 22:31:01.217830 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.217790 2567 scope.go:117] "RemoveContainer" containerID="a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5" Jul 09 22:31:01.218019 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218002 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5"} err="failed to get container status \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": rpc error: code = NotFound desc = could not find container \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": container with ID starting with a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5 not found: ID does not exist" Jul 09 22:31:01.218063 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218019 2567 scope.go:117] "RemoveContainer" containerID="1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" Jul 09 22:31:01.218212 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218192 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d"} err="failed to get container status \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": rpc error: code = NotFound desc = could not find container \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": container with ID starting with 1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d not found: ID does not exist" Jul 09 22:31:01.218255 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218212 2567 scope.go:117] "RemoveContainer" containerID="0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" Jul 09 22:31:01.218408 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218393 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22"} err="failed to get container status \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": rpc error: code = NotFound desc = could not find container \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": container with ID starting with 0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22 not found: ID does not exist" Jul 09 22:31:01.218447 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218408 2567 scope.go:117] "RemoveContainer" containerID="0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" Jul 09 22:31:01.218631 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218612 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82"} err="failed to get container status \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": rpc error: code = NotFound desc = could not find container \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": container with ID starting with 0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82 not found: ID does not exist" Jul 09 22:31:01.218674 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218631 2567 scope.go:117] "RemoveContainer" containerID="b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" Jul 09 22:31:01.218816 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218801 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8"} err="failed to get container status \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": rpc error: code = NotFound desc = could not find container \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": container with ID starting with b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8 not found: ID does not exist" Jul 09 22:31:01.218858 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.218816 2567 scope.go:117] "RemoveContainer" containerID="74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" Jul 09 22:31:01.219044 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.219027 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39"} err="failed to get container status \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": rpc error: code = NotFound desc = could not find container \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": container with ID starting with 74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39 not found: ID does not exist" Jul 09 22:31:01.219093 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.219045 2567 scope.go:117] "RemoveContainer" containerID="ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" Jul 09 22:31:01.219237 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.219217 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5"} err="failed to get container status \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": rpc error: code = NotFound desc = could not find container \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": container with ID starting with ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5 not found: ID does not exist" Jul 09 22:31:01.219281 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.219239 2567 scope.go:117] "RemoveContainer" containerID="a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5" Jul 09 22:31:01.219492 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.219475 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5"} err="failed to get container status \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": rpc error: code = NotFound desc = could not find container \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": container with ID starting with a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5 not found: ID does not exist" Jul 09 22:31:01.219540 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.219494 2567 scope.go:117] "RemoveContainer" containerID="1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" Jul 09 22:31:01.219791 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.219767 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d"} err="failed to get container status \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": rpc error: code = NotFound desc = could not find container \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": container with ID starting with 1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d not found: ID does not exist" Jul 09 22:31:01.219791 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.219785 2567 scope.go:117] "RemoveContainer" containerID="0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" Jul 09 22:31:01.220089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220071 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22"} err="failed to get container status \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": rpc error: code = NotFound desc = could not find container \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": container with ID starting with 0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22 not found: ID does not exist" Jul 09 22:31:01.220131 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220090 2567 scope.go:117] "RemoveContainer" containerID="0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" Jul 09 22:31:01.220299 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220282 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82"} err="failed to get container status \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": rpc error: code = NotFound desc = could not find container \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": container with ID starting with 0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82 not found: ID does not exist" Jul 09 22:31:01.220348 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220309 2567 scope.go:117] "RemoveContainer" containerID="b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" Jul 09 22:31:01.220517 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220500 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8"} err="failed to get container status \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": rpc error: code = NotFound desc = could not find container \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": container with ID starting with b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8 not found: ID does not exist" Jul 09 22:31:01.220556 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220518 2567 scope.go:117] "RemoveContainer" containerID="74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" Jul 09 22:31:01.220690 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220674 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39"} err="failed to get container status \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": rpc error: code = NotFound desc = could not find container \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": container with ID starting with 74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39 not found: ID does not exist" Jul 09 22:31:01.220735 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220690 2567 scope.go:117] "RemoveContainer" containerID="ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" Jul 09 22:31:01.220860 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220845 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5"} err="failed to get container status \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": rpc error: code = NotFound desc = could not find container \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": container with ID starting with ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5 not found: ID does not exist" Jul 09 22:31:01.220899 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.220859 2567 scope.go:117] "RemoveContainer" containerID="a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5" Jul 09 22:31:01.221069 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221052 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5"} err="failed to get container status \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": rpc error: code = NotFound desc = could not find container \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": container with ID starting with a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5 not found: ID does not exist" Jul 09 22:31:01.221120 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221071 2567 scope.go:117] "RemoveContainer" containerID="1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d" Jul 09 22:31:01.221279 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221262 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d"} err="failed to get container status \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": rpc error: code = NotFound desc = could not find container \"1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d\": container with ID starting with 1c71346ba2405bcdc253e1dc0f662e604d4d8c8d9bccdb471a875675061bfa8d not found: ID does not exist" Jul 09 22:31:01.221327 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221279 2567 scope.go:117] "RemoveContainer" containerID="0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22" Jul 09 22:31:01.221478 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221460 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22"} err="failed to get container status \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": rpc error: code = NotFound desc = could not find container \"0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22\": container with ID starting with 0eccddd032b6f86c5f11df81ce88b6f2ad530064c61f3bf99e8bbefaf0136a22 not found: ID does not exist" Jul 09 22:31:01.221519 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221479 2567 scope.go:117] "RemoveContainer" containerID="0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82" Jul 09 22:31:01.221659 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221643 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82"} err="failed to get container status \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": rpc error: code = NotFound desc = could not find container \"0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82\": container with ID starting with 0bf3c3f20e5d5c06fe6fa7f885771313d7f43127d37cba909fd12c3621ed3d82 not found: ID does not exist" Jul 09 22:31:01.221700 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221659 2567 scope.go:117] "RemoveContainer" containerID="b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8" Jul 09 22:31:01.221838 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221822 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8"} err="failed to get container status \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": rpc error: code = NotFound desc = could not find container \"b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8\": container with ID starting with b18645a6a2bd14d61902d50994063d2364e415e52c71661d4e8adf0316d3cfc8 not found: ID does not exist" Jul 09 22:31:01.221882 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.221839 2567 scope.go:117] "RemoveContainer" containerID="74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39" Jul 09 22:31:01.222093 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.222074 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39"} err="failed to get container status \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": rpc error: code = NotFound desc = could not find container \"74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39\": container with ID starting with 74621ea9062c9d2f18d08dece0736a1659ca6d5c5e529acc9582c900f75e8d39 not found: ID does not exist" Jul 09 22:31:01.222166 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.222093 2567 scope.go:117] "RemoveContainer" containerID="ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5" Jul 09 22:31:01.222302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.222286 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5"} err="failed to get container status \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": rpc error: code = NotFound desc = could not find container \"ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5\": container with ID starting with ed9d17b30e4163e0e406cabc720680d10124e959ae438922e3fea9d7a1f6bfe5 not found: ID does not exist" Jul 09 22:31:01.222358 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.222303 2567 scope.go:117] "RemoveContainer" containerID="a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5" Jul 09 22:31:01.222494 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.222478 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5"} err="failed to get container status \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": rpc error: code = NotFound desc = could not find container \"a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5\": container with ID starting with a96a1600adbcd8fcc6cac5daaaa8896e82cc2a6b4e70948f0eb1916ce182ffa5 not found: ID does not exist" Jul 09 22:31:01.227022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227000 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 22:31:01.227325 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227312 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy" Jul 09 22:31:01.227367 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227326 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy" Jul 09 22:31:01.227367 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227337 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="prometheus" Jul 09 22:31:01.227367 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227343 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="prometheus" Jul 09 22:31:01.227367 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227348 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="config-reloader" Jul 09 22:31:01.227367 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227354 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="config-reloader" Jul 09 22:31:01.227367 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227360 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy-thanos" Jul 09 22:31:01.227367 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227365 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy-thanos" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227373 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy-web" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227379 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy-web" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227388 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="init-config-reloader" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227393 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="init-config-reloader" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227403 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="thanos-sidecar" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227408 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="thanos-sidecar" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227459 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="prometheus" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227466 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="thanos-sidecar" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227472 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227479 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy-thanos" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227484 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="config-reloader" Jul 09 22:31:01.227620 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.227490 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" containerName="kube-rbac-proxy-web" Jul 09 22:31:01.232847 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.232825 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.235565 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.235544 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 22:31:01.236819 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.236798 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 22:31:01.236937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.236837 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 22:31:01.236937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.236857 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 22:31:01.236937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.236886 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 22:31:01.236937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.236932 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 22:31:01.237146 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.236938 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-24f1d9c442kt6\"" Jul 09 22:31:01.237284 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.237270 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 22:31:01.237386 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.237371 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 22:31:01.237447 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.237372 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 22:31:01.237447 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.237400 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 22:31:01.237548 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.237462 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 22:31:01.237548 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.237473 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 22:31:01.238057 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.238041 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p4g24\"" Jul 09 22:31:01.245528 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.245495 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 22:31:01.246704 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.246686 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 22:31:01.257841 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.257811 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 22:31:01.378585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-config-out\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.378585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.378820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.378820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.378820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378706 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.378820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378737 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.378820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.378820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.378820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378869 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-web-config\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76whz\" (UniqueName: \"kubernetes.io/projected/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-kube-api-access-76whz\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.378983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-config\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.379001 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.379036 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379089 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.379052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379368 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.379120 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.379368 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.379140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.479906 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.479866 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.479906 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.479906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-config-out\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480255 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480348 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480415 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480482 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-web-config\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76whz\" (UniqueName: \"kubernetes.io/projected/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-kube-api-access-76whz\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480631 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-config\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480781 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.480971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.480794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.481456 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.481111 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.481456 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.481366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.481983 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.481956 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.482826 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.482482 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.482941 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.482827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.483495 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.483171 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.483495 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.483208 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.483495 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.483431 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.483706 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.483567 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.484937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.484142 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.484937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.484829 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.485492 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.485238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.485492 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.485308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-config-out\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.485757 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.485729 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.485837 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.485774 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-web-config\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.486105 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.486085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-config\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.486226 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.486209 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.486654 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.486632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.494416 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.494393 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76whz\" (UniqueName: \"kubernetes.io/projected/22cc17a9-ca0f-49fa-b8b7-850a2c89fa40-kube-api-access-76whz\") pod \"prometheus-k8s-0\" (UID: \"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.543634 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.543603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:01.742188 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:01.742161 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 22:31:01.743493 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:31:01.743467 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22cc17a9_ca0f_49fa_b8b7_850a2c89fa40.slice/crio-546c78f1973497929f162a718a1d60fd3f7e12ce6fe0ff85a6a43af6c77ef83a WatchSource:0}: Error finding container 546c78f1973497929f162a718a1d60fd3f7e12ce6fe0ff85a6a43af6c77ef83a: Status 404 returned error can't find the container with id 546c78f1973497929f162a718a1d60fd3f7e12ce6fe0ff85a6a43af6c77ef83a Jul 09 22:31:02.160092 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:02.160057 2567 generic.go:356] "Generic (PLEG): container finished" podID="22cc17a9-ca0f-49fa-b8b7-850a2c89fa40" containerID="a6743b94fdb390796da1c7b02afddf9fd726f5e87d11f8d9647adec1e65b5f3e" exitCode=0 Jul 09 22:31:02.160270 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:02.160125 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40","Type":"ContainerDied","Data":"a6743b94fdb390796da1c7b02afddf9fd726f5e87d11f8d9647adec1e65b5f3e"} Jul 09 22:31:02.160270 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:02.160196 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40","Type":"ContainerStarted","Data":"546c78f1973497929f162a718a1d60fd3f7e12ce6fe0ff85a6a43af6c77ef83a"} Jul 09 22:31:03.168112 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:03.168074 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40","Type":"ContainerStarted","Data":"cea9b5593e4593d2a474625b43926f345cb2a8992cdb1ac0ecd96b5f4b57cac8"} Jul 09 22:31:03.168533 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:03.168188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40","Type":"ContainerStarted","Data":"24e91b9fd28ca26050b8b597232919796a8c89dc178a7f6f169dd094171d8a82"} Jul 09 22:31:03.168533 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:03.168232 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40","Type":"ContainerStarted","Data":"14a1c033190f30e9be0e7d2cdc175aafac9c2075d15def535526a08d04eb2220"} Jul 09 22:31:03.168533 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:03.168276 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40","Type":"ContainerStarted","Data":"9934e28decc57d5f669fe33bdf3533f4e7731926e96658709b78368614537c6a"} Jul 09 22:31:03.168533 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:03.168313 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40","Type":"ContainerStarted","Data":"af2cccb08c91343ac4e80a0040268052e0769df718ed00f71ad227f7c71d3c82"} Jul 09 22:31:03.168533 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:03.168354 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22cc17a9-ca0f-49fa-b8b7-850a2c89fa40","Type":"ContainerStarted","Data":"6bd28ac303086723700c83e48ddbfc5557db694fdc701d0873fd9ab6b27fb18c"} Jul 09 22:31:03.178164 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:03.178134 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ed619fb-39fc-4fa9-8788-7797d8e884c7" path="/var/lib/kubelet/pods/1ed619fb-39fc-4fa9-8788-7797d8e884c7/volumes" Jul 09 22:31:03.206279 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:03.206224 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.188183165 podStartE2EDuration="2.20620273s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.019565ms" isStatefulPod=false podCreationTimestamp="2026-07-09 22:31:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:31:03.206149596 +0000 UTC m=+178.503576895" watchObservedRunningTime="2026-07-09 22:31:03.20620273 +0000 UTC m=+178.503630029" Jul 09 22:31:06.544337 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:06.544299 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:31:22.221470 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.221424 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6bd47c7868-j5hg5" podUID="9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" containerName="console" containerID="cri-o://57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3" gracePeriod=15 Jul 09 22:31:22.465398 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.465369 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:31:22.553759 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.553720 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxfgv\" (UniqueName: \"kubernetes.io/projected/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-kube-api-access-xxfgv\") pod \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " Jul 09 22:31:22.553982 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.553763 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-trusted-ca-bundle\") pod \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " Jul 09 22:31:22.553982 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.553809 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-serving-cert\") pod \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " Jul 09 22:31:22.553982 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.553829 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-oauth-serving-cert\") pod \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " Jul 09 22:31:22.553982 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.553862 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-oauth-config\") pod \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " Jul 09 22:31:22.553982 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.553878 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-service-ca\") pod \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " Jul 09 22:31:22.553982 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.553968 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-config\") pod \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\" (UID: \"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9\") " Jul 09 22:31:22.554347 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.554302 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" (UID: "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:22.554347 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.554323 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" (UID: "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:22.554536 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.554502 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-service-ca" (OuterVolumeSpecName: "service-ca") pod "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" (UID: "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:22.554658 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.554609 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-config" (OuterVolumeSpecName: "console-config") pod "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" (UID: "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:31:22.556022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.555992 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" (UID: "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:22.556114 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.556002 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" (UID: "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:31:22.556114 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.555999 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-kube-api-access-xxfgv" (OuterVolumeSpecName: "kube-api-access-xxfgv") pod "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" (UID: "9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9"). InnerVolumeSpecName "kube-api-access-xxfgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:31:22.655425 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.655387 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-oauth-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:22.655425 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.655419 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-service-ca\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:22.655425 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.655428 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:22.655425 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.655436 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxfgv\" (UniqueName: \"kubernetes.io/projected/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-kube-api-access-xxfgv\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:22.655703 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.655446 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-trusted-ca-bundle\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:22.655703 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.655455 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-console-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:22.655703 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:22.655463 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9-oauth-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:31:23.252623 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:23.252588 2567 generic.go:356] "Generic (PLEG): container finished" podID="9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" containerID="57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3" exitCode=0 Jul 09 22:31:23.253132 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:23.252639 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd47c7868-j5hg5" Jul 09 22:31:23.253132 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:23.252673 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd47c7868-j5hg5" event={"ID":"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9","Type":"ContainerDied","Data":"57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3"} Jul 09 22:31:23.253132 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:23.252726 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd47c7868-j5hg5" event={"ID":"9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9","Type":"ContainerDied","Data":"0a5eb89cf60a6820b0a5ad3469e878335371796d5a71f793cf53442b1a6eb6ad"} Jul 09 22:31:23.253132 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:23.252746 2567 scope.go:117] "RemoveContainer" containerID="57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3" Jul 09 22:31:23.261078 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:23.261061 2567 scope.go:117] "RemoveContainer" containerID="57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3" Jul 09 22:31:23.261336 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:31:23.261313 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3\": container with ID starting with 57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3 not found: ID does not exist" containerID="57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3" Jul 09 22:31:23.261400 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:23.261349 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3"} err="failed to get container status \"57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3\": rpc error: code = NotFound desc = could not find container \"57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3\": container with ID starting with 57f717dac30de51a3d49fc7b5c4000d9bf97b79dc5e7faef0f4ee45ad2df9fb3 not found: ID does not exist" Jul 09 22:31:23.271153 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:23.271131 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bd47c7868-j5hg5"] Jul 09 22:31:23.277377 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:23.277357 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bd47c7868-j5hg5"] Jul 09 22:31:25.178687 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:31:25.178654 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" path="/var/lib/kubelet/pods/9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9/volumes" Jul 09 22:32:01.544023 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:01.543991 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:32:01.559894 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:01.559858 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:32:02.430622 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:02.430591 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 22:32:48.144995 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.144961 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b9b7dfc5-gpxdw"] Jul 09 22:32:48.145406 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.145306 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" containerName="console" Jul 09 22:32:48.145406 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.145317 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" containerName="console" Jul 09 22:32:48.145406 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.145377 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9648c0ac-7aea-4b7b-8c7a-cfcb89a4e6c9" containerName="console" Jul 09 22:32:48.148409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.148394 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.166237 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.166200 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b9b7dfc5-gpxdw"] Jul 09 22:32:48.209976 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.209934 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-trusted-ca-bundle\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.209976 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.209980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph6zx\" (UniqueName: \"kubernetes.io/projected/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-kube-api-access-ph6zx\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.210176 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.210023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-config\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.210176 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.210051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-service-ca\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.210176 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.210103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-oauth-serving-cert\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.210176 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.210167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-oauth-config\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.210315 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.210198 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-serving-cert\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.310837 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.310801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-config\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.310837 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.310843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-service-ca\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.311083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.310859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-oauth-serving-cert\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.311083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.310900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-oauth-config\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.311083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.310944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-serving-cert\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.311083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.310973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-trusted-ca-bundle\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.311083 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.310998 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph6zx\" (UniqueName: \"kubernetes.io/projected/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-kube-api-access-ph6zx\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.311737 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.311711 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-oauth-serving-cert\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.311862 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.311711 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-config\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.311862 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.311833 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-trusted-ca-bundle\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.312051 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.312034 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-service-ca\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.313379 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.313356 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-oauth-config\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.313477 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.313459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-serving-cert\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.321301 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.321277 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph6zx\" (UniqueName: \"kubernetes.io/projected/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-kube-api-access-ph6zx\") pod \"console-7b9b7dfc5-gpxdw\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.458078 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.457980 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:48.598034 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.598006 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b9b7dfc5-gpxdw"] Jul 09 22:32:48.605730 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:48.605699 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9b7dfc5-gpxdw" event={"ID":"7cea9aae-2f9b-4fe6-9e86-2f9681884c92","Type":"ContainerStarted","Data":"74616bc00e50f1884e71a7520def5c803ce78f24c105c07067cbb8f835174044"} Jul 09 22:32:49.611049 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:49.611014 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9b7dfc5-gpxdw" event={"ID":"7cea9aae-2f9b-4fe6-9e86-2f9681884c92","Type":"ContainerStarted","Data":"3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27"} Jul 09 22:32:49.631216 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:49.631162 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b9b7dfc5-gpxdw" podStartSLOduration=1.6311446360000001 podStartE2EDuration="1.631144636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:49.630957476 +0000 UTC m=+284.928384774" watchObservedRunningTime="2026-07-09 22:32:49.631144636 +0000 UTC m=+284.928571934" Jul 09 22:32:58.459015 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:58.458976 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:58.459614 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:58.459040 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:58.463866 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:58.463841 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:58.656759 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:58.656731 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:32:58.711431 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:32:58.711354 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5677454c8b-kf8gz"] Jul 09 22:33:05.060518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:05.060491 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 22:33:23.739267 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:23.739203 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5677454c8b-kf8gz" podUID="cd3ac3de-4261-49fc-88bd-48cffd210c9a" containerName="console" containerID="cri-o://47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54" gracePeriod=15 Jul 09 22:33:23.981512 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:23.981487 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:33:24.127700 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.127668 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-serving-cert\") pod \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " Jul 09 22:33:24.127700 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.127707 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-service-ca\") pod \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " Jul 09 22:33:24.127994 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.127732 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-trusted-ca-bundle\") pod \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " Jul 09 22:33:24.127994 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.127759 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-oauth-config\") pod \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " Jul 09 22:33:24.127994 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.127796 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r44gf\" (UniqueName: \"kubernetes.io/projected/cd3ac3de-4261-49fc-88bd-48cffd210c9a-kube-api-access-r44gf\") pod \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " Jul 09 22:33:24.127994 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.127825 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-oauth-serving-cert\") pod \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " Jul 09 22:33:24.127994 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.127877 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-config\") pod \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\" (UID: \"cd3ac3de-4261-49fc-88bd-48cffd210c9a\") " Jul 09 22:33:24.128253 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.128234 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd3ac3de-4261-49fc-88bd-48cffd210c9a" (UID: "cd3ac3de-4261-49fc-88bd-48cffd210c9a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:33:24.128349 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.128252 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd3ac3de-4261-49fc-88bd-48cffd210c9a" (UID: "cd3ac3de-4261-49fc-88bd-48cffd210c9a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:33:24.128392 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.128246 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd3ac3de-4261-49fc-88bd-48cffd210c9a" (UID: "cd3ac3de-4261-49fc-88bd-48cffd210c9a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:33:24.128448 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.128427 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-config" (OuterVolumeSpecName: "console-config") pod "cd3ac3de-4261-49fc-88bd-48cffd210c9a" (UID: "cd3ac3de-4261-49fc-88bd-48cffd210c9a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:33:24.130055 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.130031 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd3ac3de-4261-49fc-88bd-48cffd210c9a-kube-api-access-r44gf" (OuterVolumeSpecName: "kube-api-access-r44gf") pod "cd3ac3de-4261-49fc-88bd-48cffd210c9a" (UID: "cd3ac3de-4261-49fc-88bd-48cffd210c9a"). InnerVolumeSpecName "kube-api-access-r44gf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:33:24.130412 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.130392 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd3ac3de-4261-49fc-88bd-48cffd210c9a" (UID: "cd3ac3de-4261-49fc-88bd-48cffd210c9a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:33:24.130475 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.130440 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd3ac3de-4261-49fc-88bd-48cffd210c9a" (UID: "cd3ac3de-4261-49fc-88bd-48cffd210c9a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:33:24.228884 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.228851 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-oauth-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:33:24.228884 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.228882 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:33:24.228884 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.228892 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:33:24.229156 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.228900 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-service-ca\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:33:24.229156 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.228921 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3ac3de-4261-49fc-88bd-48cffd210c9a-trusted-ca-bundle\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:33:24.229156 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.228930 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd3ac3de-4261-49fc-88bd-48cffd210c9a-console-oauth-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:33:24.229156 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.228938 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r44gf\" (UniqueName: \"kubernetes.io/projected/cd3ac3de-4261-49fc-88bd-48cffd210c9a-kube-api-access-r44gf\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:33:24.762728 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.762694 2567 generic.go:356] "Generic (PLEG): container finished" podID="cd3ac3de-4261-49fc-88bd-48cffd210c9a" containerID="47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54" exitCode=0 Jul 09 22:33:24.763172 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.762745 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5677454c8b-kf8gz" Jul 09 22:33:24.763172 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.762783 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5677454c8b-kf8gz" event={"ID":"cd3ac3de-4261-49fc-88bd-48cffd210c9a","Type":"ContainerDied","Data":"47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54"} Jul 09 22:33:24.763172 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.762838 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5677454c8b-kf8gz" event={"ID":"cd3ac3de-4261-49fc-88bd-48cffd210c9a","Type":"ContainerDied","Data":"456d4a8d50122907c1605805fcb8ae1daa002989a3339d1170acd348f30a2c81"} Jul 09 22:33:24.763172 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.762858 2567 scope.go:117] "RemoveContainer" containerID="47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54" Jul 09 22:33:24.771748 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.771730 2567 scope.go:117] "RemoveContainer" containerID="47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54" Jul 09 22:33:24.772162 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:33:24.772142 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54\": container with ID starting with 47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54 not found: ID does not exist" containerID="47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54" Jul 09 22:33:24.772238 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.772175 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54"} err="failed to get container status \"47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54\": rpc error: code = NotFound desc = could not find container \"47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54\": container with ID starting with 47a54942f9863d633296d1768f5f886f20e53c9043440ebc3da96b8a146d6b54 not found: ID does not exist" Jul 09 22:33:24.787185 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.787156 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5677454c8b-kf8gz"] Jul 09 22:33:24.790022 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:24.789993 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5677454c8b-kf8gz"] Jul 09 22:33:25.177722 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:25.177691 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd3ac3de-4261-49fc-88bd-48cffd210c9a" path="/var/lib/kubelet/pods/cd3ac3de-4261-49fc-88bd-48cffd210c9a/volumes" Jul 09 22:33:51.693343 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.693305 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-47pg2"] Jul 09 22:33:51.693794 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.693632 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd3ac3de-4261-49fc-88bd-48cffd210c9a" containerName="console" Jul 09 22:33:51.693794 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.693642 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd3ac3de-4261-49fc-88bd-48cffd210c9a" containerName="console" Jul 09 22:33:51.693794 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.693713 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd3ac3de-4261-49fc-88bd-48cffd210c9a" containerName="console" Jul 09 22:33:51.696757 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.696739 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-47pg2" Jul 09 22:33:51.718759 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.718736 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 22:33:51.718876 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.718741 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 22:33:51.720088 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.720073 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kp5qj\"" Jul 09 22:33:51.757604 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.757567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6ddh\" (UniqueName: \"kubernetes.io/projected/7b1f0de7-454c-4111-bc71-3f284239898f-kube-api-access-b6ddh\") pod \"cert-manager-55b4d954d5-47pg2\" (UID: \"7b1f0de7-454c-4111-bc71-3f284239898f\") " pod="cert-manager/cert-manager-55b4d954d5-47pg2" Jul 09 22:33:51.757604 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.757604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b1f0de7-454c-4111-bc71-3f284239898f-bound-sa-token\") pod \"cert-manager-55b4d954d5-47pg2\" (UID: \"7b1f0de7-454c-4111-bc71-3f284239898f\") " pod="cert-manager/cert-manager-55b4d954d5-47pg2" Jul 09 22:33:51.772402 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.772372 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-47pg2"] Jul 09 22:33:51.858840 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.858793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ddh\" (UniqueName: \"kubernetes.io/projected/7b1f0de7-454c-4111-bc71-3f284239898f-kube-api-access-b6ddh\") pod \"cert-manager-55b4d954d5-47pg2\" (UID: \"7b1f0de7-454c-4111-bc71-3f284239898f\") " pod="cert-manager/cert-manager-55b4d954d5-47pg2" Jul 09 22:33:51.858840 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.858839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b1f0de7-454c-4111-bc71-3f284239898f-bound-sa-token\") pod \"cert-manager-55b4d954d5-47pg2\" (UID: \"7b1f0de7-454c-4111-bc71-3f284239898f\") " pod="cert-manager/cert-manager-55b4d954d5-47pg2" Jul 09 22:33:51.875891 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.875863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b1f0de7-454c-4111-bc71-3f284239898f-bound-sa-token\") pod \"cert-manager-55b4d954d5-47pg2\" (UID: \"7b1f0de7-454c-4111-bc71-3f284239898f\") " pod="cert-manager/cert-manager-55b4d954d5-47pg2" Jul 09 22:33:51.876054 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:51.876011 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6ddh\" (UniqueName: \"kubernetes.io/projected/7b1f0de7-454c-4111-bc71-3f284239898f-kube-api-access-b6ddh\") pod \"cert-manager-55b4d954d5-47pg2\" (UID: \"7b1f0de7-454c-4111-bc71-3f284239898f\") " pod="cert-manager/cert-manager-55b4d954d5-47pg2" Jul 09 22:33:52.016728 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.016644 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-47pg2" Jul 09 22:33:52.151643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.151606 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-47pg2"] Jul 09 22:33:52.154600 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:33:52.154570 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b1f0de7_454c_4111_bc71_3f284239898f.slice/crio-11363dc539b5049050e9707ba2b5ff75c13ec9c78dcff7ef2cfe639bc1604346 WatchSource:0}: Error finding container 11363dc539b5049050e9707ba2b5ff75c13ec9c78dcff7ef2cfe639bc1604346: Status 404 returned error can't find the container with id 11363dc539b5049050e9707ba2b5ff75c13ec9c78dcff7ef2cfe639bc1604346 Jul 09 22:33:52.156629 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.156611 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 22:33:52.884183 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.884137 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9"] Jul 09 22:33:52.888146 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.888105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-47pg2" event={"ID":"7b1f0de7-454c-4111-bc71-3f284239898f","Type":"ContainerStarted","Data":"11363dc539b5049050e9707ba2b5ff75c13ec9c78dcff7ef2cfe639bc1604346"} Jul 09 22:33:52.888317 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.888232 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" Jul 09 22:33:52.891469 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.891438 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 22:33:52.892219 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.892030 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wwjjd\"" Jul 09 22:33:52.892219 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.892055 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 22:33:52.897216 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.897189 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9"] Jul 09 22:33:52.970504 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.970444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv8vt\" (UniqueName: \"kubernetes.io/projected/4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef-kube-api-access-fv8vt\") pod \"openshift-lws-operator-fd8ccff4c-hcps9\" (UID: \"4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" Jul 09 22:33:52.970704 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:52.970571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hcps9\" (UID: \"4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" Jul 09 22:33:53.071932 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:53.071874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hcps9\" (UID: \"4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" Jul 09 22:33:53.072120 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:53.072004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv8vt\" (UniqueName: \"kubernetes.io/projected/4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef-kube-api-access-fv8vt\") pod \"openshift-lws-operator-fd8ccff4c-hcps9\" (UID: \"4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" Jul 09 22:33:53.072646 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:53.072616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hcps9\" (UID: \"4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" Jul 09 22:33:53.088876 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:53.088843 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv8vt\" (UniqueName: \"kubernetes.io/projected/4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef-kube-api-access-fv8vt\") pod \"openshift-lws-operator-fd8ccff4c-hcps9\" (UID: \"4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" Jul 09 22:33:53.202807 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:53.202699 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" Jul 09 22:33:53.391166 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:53.391124 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9"] Jul 09 22:33:53.394444 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:33:53.394411 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4789afc8_54d6_4fcb_89b2_4c2e1c54c6ef.slice/crio-614f5e6880504e158ad1a69f7a4c8f90cfc49372c6b708576bf8a4fef1c307b5 WatchSource:0}: Error finding container 614f5e6880504e158ad1a69f7a4c8f90cfc49372c6b708576bf8a4fef1c307b5: Status 404 returned error can't find the container with id 614f5e6880504e158ad1a69f7a4c8f90cfc49372c6b708576bf8a4fef1c307b5 Jul 09 22:33:53.892592 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:53.892538 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" event={"ID":"4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef","Type":"ContainerStarted","Data":"614f5e6880504e158ad1a69f7a4c8f90cfc49372c6b708576bf8a4fef1c307b5"} Jul 09 22:33:55.905700 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:55.904960 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-47pg2" event={"ID":"7b1f0de7-454c-4111-bc71-3f284239898f","Type":"ContainerStarted","Data":"ea5e23b5ef2c56b23d9cef445b9a058657e65065531488e3284795da46c41204"} Jul 09 22:33:55.923710 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:55.923625 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-47pg2" podStartSLOduration=1.793449898 podStartE2EDuration="4.923600592s" totalImagesPullingTime="3.130150694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:55.9221967 +0000 UTC m=+351.219624016" watchObservedRunningTime="2026-07-09 22:33:55.923600592 +0000 UTC m=+351.221027892" Jul 09 22:33:57.921204 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:57.921163 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" event={"ID":"4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef","Type":"ContainerStarted","Data":"fc542836eaf43d0b13d000e425dc2cfeb39a2a4b4ec8c7a3aa70043427d76bec"} Jul 09 22:33:57.942098 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:33:57.942043 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hcps9" podStartSLOduration=2.180630815 podStartE2EDuration="5.942027235s" totalImagesPullingTime="3.76139642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:57.940614106 +0000 UTC m=+353.238041405" watchObservedRunningTime="2026-07-09 22:33:57.942027235 +0000 UTC m=+353.239454531" Jul 09 22:34:13.841048 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.841010 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq"] Jul 09 22:34:13.846131 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.846106 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.852753 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.852438 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dsh7n\"" Jul 09 22:34:13.852753 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.852549 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 22:34:13.852879 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.852861 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 22:34:13.852962 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.852945 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 22:34:13.855123 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.855101 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 22:34:13.866309 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.866280 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq"] Jul 09 22:34:13.872892 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.872869 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/164a1216-4204-46f1-a4d1-8f4d4528fe5b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.873034 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.872908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/164a1216-4204-46f1-a4d1-8f4d4528fe5b-tmp\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.873034 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.872957 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/164a1216-4204-46f1-a4d1-8f4d4528fe5b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.873034 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.872981 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzxps\" (UniqueName: \"kubernetes.io/projected/164a1216-4204-46f1-a4d1-8f4d4528fe5b-kube-api-access-mzxps\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.873189 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.873051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/164a1216-4204-46f1-a4d1-8f4d4528fe5b-manifests\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.974046 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.974004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/164a1216-4204-46f1-a4d1-8f4d4528fe5b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.974046 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.974045 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/164a1216-4204-46f1-a4d1-8f4d4528fe5b-tmp\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.974260 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.974062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/164a1216-4204-46f1-a4d1-8f4d4528fe5b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.974260 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.974080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzxps\" (UniqueName: \"kubernetes.io/projected/164a1216-4204-46f1-a4d1-8f4d4528fe5b-kube-api-access-mzxps\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.974260 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.974118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/164a1216-4204-46f1-a4d1-8f4d4528fe5b-manifests\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.974582 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.974555 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/164a1216-4204-46f1-a4d1-8f4d4528fe5b-manifests\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.976427 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.976399 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/164a1216-4204-46f1-a4d1-8f4d4528fe5b-tmp\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.976542 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.976528 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/164a1216-4204-46f1-a4d1-8f4d4528fe5b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.976605 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.976590 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/164a1216-4204-46f1-a4d1-8f4d4528fe5b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:13.984006 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:13.983964 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzxps\" (UniqueName: \"kubernetes.io/projected/164a1216-4204-46f1-a4d1-8f4d4528fe5b-kube-api-access-mzxps\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-2lzcq\" (UID: \"164a1216-4204-46f1-a4d1-8f4d4528fe5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:14.156876 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:14.156788 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:14.314123 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:14.314045 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq"] Jul 09 22:34:14.314616 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:34:14.314585 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164a1216_4204_46f1_a4d1_8f4d4528fe5b.slice/crio-b21ac57c5afaa31440c78c4acec3b4f264c29eca7090ec59a5f9ca5b9ebf365f WatchSource:0}: Error finding container b21ac57c5afaa31440c78c4acec3b4f264c29eca7090ec59a5f9ca5b9ebf365f: Status 404 returned error can't find the container with id b21ac57c5afaa31440c78c4acec3b4f264c29eca7090ec59a5f9ca5b9ebf365f Jul 09 22:34:15.002893 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:15.002854 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" event={"ID":"164a1216-4204-46f1-a4d1-8f4d4528fe5b","Type":"ContainerStarted","Data":"b21ac57c5afaa31440c78c4acec3b4f264c29eca7090ec59a5f9ca5b9ebf365f"} Jul 09 22:34:18.019545 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:18.019506 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" event={"ID":"164a1216-4204-46f1-a4d1-8f4d4528fe5b","Type":"ContainerStarted","Data":"4a9772850314dab055b158e97feb6745769993eb7d257d8ef616967bfe152f67"} Jul 09 22:34:19.025609 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:19.025567 2567 generic.go:356] "Generic (PLEG): container finished" podID="164a1216-4204-46f1-a4d1-8f4d4528fe5b" containerID="4a9772850314dab055b158e97feb6745769993eb7d257d8ef616967bfe152f67" exitCode=0 Jul 09 22:34:19.025990 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:19.025614 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" event={"ID":"164a1216-4204-46f1-a4d1-8f4d4528fe5b","Type":"ContainerDied","Data":"4a9772850314dab055b158e97feb6745769993eb7d257d8ef616967bfe152f67"} Jul 09 22:34:20.034078 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:20.034038 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" event={"ID":"164a1216-4204-46f1-a4d1-8f4d4528fe5b","Type":"ContainerStarted","Data":"55ede0a6acadff185753f220d9d67a8b5daf0087b4fa5052aa515361040b9504"} Jul 09 22:34:20.034566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:20.034201 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:20.059439 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:20.059373 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" podStartSLOduration=2.700295965 podStartE2EDuration="7.059352837s" totalImagesPullingTime="3.223531776s" totalInitContainerRuntime="1.135525096s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:34:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:34:20.05737558 +0000 UTC m=+375.354802879" watchObservedRunningTime="2026-07-09 22:34:20.059352837 +0000 UTC m=+375.356780135" Jul 09 22:34:31.041336 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:31.041304 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-2lzcq" Jul 09 22:34:52.971540 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:52.971504 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx"] Jul 09 22:34:52.981138 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:52.981109 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:52.983808 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:52.983786 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 22:34:52.984074 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:52.984056 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 22:34:52.984144 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:52.984076 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 22:34:52.984340 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:52.984326 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z8wch\"" Jul 09 22:34:52.991344 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:52.991317 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx"] Jul 09 22:34:53.137038 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.137008 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.137211 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.137041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.137211 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.137081 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.137211 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.137103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.137211 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.137121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfjrh\" (UniqueName: \"kubernetes.io/projected/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-kube-api-access-wfjrh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.137211 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.137205 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.137386 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.137231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.137386 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.137335 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.137449 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.137389 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.158760 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.158726 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd"] Jul 09 22:34:53.163774 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.163738 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.168516 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.168485 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 22:34:53.168516 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.168513 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 22:34:53.169717 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.169697 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 22:34:53.172777 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.172759 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8ztb7\"" Jul 09 22:34:53.179032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.179011 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd"] Jul 09 22:34:53.238941 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.238826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.238941 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.238874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.238941 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.238902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.238941 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.238936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239286 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.238957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjrh\" (UniqueName: \"kubernetes.io/projected/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-kube-api-access-wfjrh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239286 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.238986 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239286 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.239012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239286 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.239081 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239286 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.239127 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239539 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.239343 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239539 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.239403 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239539 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.239442 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239759 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.239740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.239819 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.239809 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.241862 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.241837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.242078 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.242061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.249075 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.249046 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.249175 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.249158 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfjrh\" (UniqueName: \"kubernetes.io/projected/482367bb-ef9c-42ee-bd36-8f9ffcfcb23f-kube-api-access-wfjrh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pxmpx\" (UID: \"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.296084 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.296046 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:53.340322 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.340290 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw2kr\" (UniqueName: \"kubernetes.io/projected/625ef294-3b1a-4cae-8cb0-af4d6230607f-kube-api-access-lw2kr\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.340487 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.340341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/625ef294-3b1a-4cae-8cb0-af4d6230607f-cert\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.340487 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.340469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/625ef294-3b1a-4cae-8cb0-af4d6230607f-metrics-cert\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.340567 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.340539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/625ef294-3b1a-4cae-8cb0-af4d6230607f-manager-config\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.441961 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.441903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw2kr\" (UniqueName: \"kubernetes.io/projected/625ef294-3b1a-4cae-8cb0-af4d6230607f-kube-api-access-lw2kr\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.442160 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.442018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/625ef294-3b1a-4cae-8cb0-af4d6230607f-cert\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.442160 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.442132 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/625ef294-3b1a-4cae-8cb0-af4d6230607f-metrics-cert\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.442327 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.442221 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/625ef294-3b1a-4cae-8cb0-af4d6230607f-manager-config\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.443499 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.443472 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/625ef294-3b1a-4cae-8cb0-af4d6230607f-manager-config\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.445008 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.444987 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/625ef294-3b1a-4cae-8cb0-af4d6230607f-cert\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.445189 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.445170 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/625ef294-3b1a-4cae-8cb0-af4d6230607f-metrics-cert\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.450533 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.450513 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw2kr\" (UniqueName: \"kubernetes.io/projected/625ef294-3b1a-4cae-8cb0-af4d6230607f-kube-api-access-lw2kr\") pod \"lws-controller-manager-75dd6b9c58-2mpnd\" (UID: \"625ef294-3b1a-4cae-8cb0-af4d6230607f\") " pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.464556 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.462954 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx"] Jul 09 22:34:53.475609 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.475580 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:53.637600 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:53.637566 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd"] Jul 09 22:34:53.641763 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:34:53.641736 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625ef294_3b1a_4cae_8cb0_af4d6230607f.slice/crio-aaadde263ad05e9f33e180baada3be20271554f484b3bcd5c44360c71c3ed9aa WatchSource:0}: Error finding container aaadde263ad05e9f33e180baada3be20271554f484b3bcd5c44360c71c3ed9aa: Status 404 returned error can't find the container with id aaadde263ad05e9f33e180baada3be20271554f484b3bcd5c44360c71c3ed9aa Jul 09 22:34:54.202220 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:54.202180 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" event={"ID":"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f","Type":"ContainerStarted","Data":"a51d0b91cbb86ec23a1b28edaf61743e5f342bd19d7f19ba70a96f9a14785398"} Jul 09 22:34:54.203632 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:54.203592 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" event={"ID":"625ef294-3b1a-4cae-8cb0-af4d6230607f","Type":"ContainerStarted","Data":"aaadde263ad05e9f33e180baada3be20271554f484b3bcd5c44360c71c3ed9aa"} Jul 09 22:34:55.554607 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.554562 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk"] Jul 09 22:34:55.561976 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.561953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:34:55.564821 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.564799 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 22:34:55.564962 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.564811 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pkcd4\"" Jul 09 22:34:55.569659 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.569634 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk"] Jul 09 22:34:55.663303 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.663265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-6cbzk\" (UID: \"a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:34:55.663513 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.663308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lncvk\" (UniqueName: \"kubernetes.io/projected/a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3-kube-api-access-lncvk\") pod \"kserve-controller-manager-d6f4b65b8-6cbzk\" (UID: \"a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:34:55.764603 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.764572 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-6cbzk\" (UID: \"a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:34:55.764803 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.764616 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lncvk\" (UniqueName: \"kubernetes.io/projected/a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3-kube-api-access-lncvk\") pod \"kserve-controller-manager-d6f4b65b8-6cbzk\" (UID: \"a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:34:55.764803 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:34:55.764754 2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 22:34:55.764908 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:34:55.764820 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3-cert podName:a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:34:56.26480276 +0000 UTC m=+411.562230038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3-cert") pod "kserve-controller-manager-d6f4b65b8-6cbzk" (UID: "a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3") : secret "kserve-webhook-server-cert" not found Jul 09 22:34:55.788907 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:55.788875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lncvk\" (UniqueName: \"kubernetes.io/projected/a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3-kube-api-access-lncvk\") pod \"kserve-controller-manager-d6f4b65b8-6cbzk\" (UID: \"a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:34:56.270943 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:56.270742 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-6cbzk\" (UID: \"a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:34:56.273866 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:56.273825 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-6cbzk\" (UID: \"a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:34:56.425558 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:56.425520 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:34:56.425655 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:56.425600 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:34:56.425655 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:56.425630 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:34:56.478428 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:56.478401 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:34:56.707691 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:56.707646 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk"] Jul 09 22:34:56.711155 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:34:56.711114 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ed3c5b_feb1_490e_9a85_c0671cf7d9b3.slice/crio-0540fcd1aefafe3cf55a89c1e7b1269b4e269108f7d57e3cb6ddfc4a6de9bea8 WatchSource:0}: Error finding container 0540fcd1aefafe3cf55a89c1e7b1269b4e269108f7d57e3cb6ddfc4a6de9bea8: Status 404 returned error can't find the container with id 0540fcd1aefafe3cf55a89c1e7b1269b4e269108f7d57e3cb6ddfc4a6de9bea8 Jul 09 22:34:57.227691 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:57.227652 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" event={"ID":"625ef294-3b1a-4cae-8cb0-af4d6230607f","Type":"ContainerStarted","Data":"29016bbe2b57dc776ee66139d5b37b1e89165053dc2e2fd5543f33a0ee9bb7a7"} Jul 09 22:34:57.227877 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:57.227750 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:34:57.229369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:57.229338 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" event={"ID":"482367bb-ef9c-42ee-bd36-8f9ffcfcb23f","Type":"ContainerStarted","Data":"0a22639c2119ffb87d0e183231ff5feb419cf5e0bc4d1d3763f5f7bbc47bcf03"} Jul 09 22:34:57.230576 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:57.230528 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" event={"ID":"a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3","Type":"ContainerStarted","Data":"0540fcd1aefafe3cf55a89c1e7b1269b4e269108f7d57e3cb6ddfc4a6de9bea8"} Jul 09 22:34:57.259352 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:57.259298 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" podStartSLOduration=1.483143135 podStartE2EDuration="4.259283153s" totalImagesPullingTime="2.776140018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:34:57.258562996 +0000 UTC m=+412.555990296" watchObservedRunningTime="2026-07-09 22:34:57.259283153 +0000 UTC m=+412.556710510" Jul 09 22:34:57.295358 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:57.295304 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" podStartSLOduration=2.34007748 podStartE2EDuration="5.295289032s" totalImagesPullingTime="2.955211552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:34:57.292899158 +0000 UTC m=+412.590326456" watchObservedRunningTime="2026-07-09 22:34:57.295289032 +0000 UTC m=+412.592716394" Jul 09 22:34:57.296245 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:57.296225 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:57.302857 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:57.302823 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:58.236999 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:58.236967 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:34:58.237903 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:34:58.237879 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pxmpx" Jul 09 22:35:00.249676 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:00.249631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" event={"ID":"a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3","Type":"ContainerStarted","Data":"636d7118876cb35097105ecf7be8e51e62c078d2c33c6d85ca3c3ea3bc4a5bf5"} Jul 09 22:35:00.265953 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:00.265828 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" podStartSLOduration=2.385133997 podStartE2EDuration="5.265808929s" totalImagesPullingTime="2.880674932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:35:00.265372458 +0000 UTC m=+415.562799757" watchObservedRunningTime="2026-07-09 22:35:00.265808929 +0000 UTC m=+415.563236228" Jul 09 22:35:01.254184 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:01.254155 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:35:08.238902 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:08.238872 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75dd6b9c58-2mpnd" Jul 09 22:35:32.263569 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:32.263492 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6cbzk" Jul 09 22:35:35.669762 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.669729 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nl54t"] Jul 09 22:35:35.676203 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.676175 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" Jul 09 22:35:35.679899 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.679874 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 22:35:35.680387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.680367 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 22:35:35.680387 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.680375 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-92dbc\"" Jul 09 22:35:35.689692 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.689668 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nl54t"] Jul 09 22:35:35.747433 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.747395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnsjk\" (UniqueName: \"kubernetes.io/projected/2cbd4488-1877-4b6a-8278-77950c9150a0-kube-api-access-mnsjk\") pod \"kuadrant-operator-catalog-nl54t\" (UID: \"2cbd4488-1877-4b6a-8278-77950c9150a0\") " pod="kuadrant-system/kuadrant-operator-catalog-nl54t" Jul 09 22:35:35.848495 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.848456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnsjk\" (UniqueName: \"kubernetes.io/projected/2cbd4488-1877-4b6a-8278-77950c9150a0-kube-api-access-mnsjk\") pod \"kuadrant-operator-catalog-nl54t\" (UID: \"2cbd4488-1877-4b6a-8278-77950c9150a0\") " pod="kuadrant-system/kuadrant-operator-catalog-nl54t" Jul 09 22:35:35.857573 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.857543 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnsjk\" (UniqueName: \"kubernetes.io/projected/2cbd4488-1877-4b6a-8278-77950c9150a0-kube-api-access-mnsjk\") pod \"kuadrant-operator-catalog-nl54t\" (UID: \"2cbd4488-1877-4b6a-8278-77950c9150a0\") " pod="kuadrant-system/kuadrant-operator-catalog-nl54t" Jul 09 22:35:35.960251 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.960158 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nl54t"] Jul 09 22:35:35.960478 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:35.960461 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" Jul 09 22:35:36.099072 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.099047 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nl54t"] Jul 09 22:35:36.101190 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:35:36.101162 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cbd4488_1877_4b6a_8278_77950c9150a0.slice/crio-5ec18995083868bc340bdbbd514e6ecdd9f6871683af30b4d8db9406148e8192 WatchSource:0}: Error finding container 5ec18995083868bc340bdbbd514e6ecdd9f6871683af30b4d8db9406148e8192: Status 404 returned error can't find the container with id 5ec18995083868bc340bdbbd514e6ecdd9f6871683af30b4d8db9406148e8192 Jul 09 22:35:36.171426 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.171392 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xd878"] Jul 09 22:35:36.174365 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.174348 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xd878" Jul 09 22:35:36.183786 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.183758 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xd878"] Jul 09 22:35:36.252952 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.252819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlf84\" (UniqueName: \"kubernetes.io/projected/10bf1d7a-515b-4179-ab64-394b831f5850-kube-api-access-rlf84\") pod \"kuadrant-operator-catalog-xd878\" (UID: \"10bf1d7a-515b-4179-ab64-394b831f5850\") " pod="kuadrant-system/kuadrant-operator-catalog-xd878" Jul 09 22:35:36.354107 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.354067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlf84\" (UniqueName: \"kubernetes.io/projected/10bf1d7a-515b-4179-ab64-394b831f5850-kube-api-access-rlf84\") pod \"kuadrant-operator-catalog-xd878\" (UID: \"10bf1d7a-515b-4179-ab64-394b831f5850\") " pod="kuadrant-system/kuadrant-operator-catalog-xd878" Jul 09 22:35:36.363937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.363893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlf84\" (UniqueName: \"kubernetes.io/projected/10bf1d7a-515b-4179-ab64-394b831f5850-kube-api-access-rlf84\") pod \"kuadrant-operator-catalog-xd878\" (UID: \"10bf1d7a-515b-4179-ab64-394b831f5850\") " pod="kuadrant-system/kuadrant-operator-catalog-xd878" Jul 09 22:35:36.416511 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.416470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" event={"ID":"2cbd4488-1877-4b6a-8278-77950c9150a0","Type":"ContainerStarted","Data":"5ec18995083868bc340bdbbd514e6ecdd9f6871683af30b4d8db9406148e8192"} Jul 09 22:35:36.484719 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.484690 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xd878" Jul 09 22:35:36.686505 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:36.686473 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xd878"] Jul 09 22:35:36.763133 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:35:36.763097 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10bf1d7a_515b_4179_ab64_394b831f5850.slice/crio-080ecb6b1fa06c544df46acc13e0ade60f8ffd457c2d05fab4c2128615bd60a7 WatchSource:0}: Error finding container 080ecb6b1fa06c544df46acc13e0ade60f8ffd457c2d05fab4c2128615bd60a7: Status 404 returned error can't find the container with id 080ecb6b1fa06c544df46acc13e0ade60f8ffd457c2d05fab4c2128615bd60a7 Jul 09 22:35:37.423226 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:37.423187 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xd878" event={"ID":"10bf1d7a-515b-4179-ab64-394b831f5850","Type":"ContainerStarted","Data":"080ecb6b1fa06c544df46acc13e0ade60f8ffd457c2d05fab4c2128615bd60a7"} Jul 09 22:35:38.429154 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:38.429121 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" event={"ID":"2cbd4488-1877-4b6a-8278-77950c9150a0","Type":"ContainerStarted","Data":"b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2"} Jul 09 22:35:38.429646 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:38.429176 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" podUID="2cbd4488-1877-4b6a-8278-77950c9150a0" containerName="registry-server" containerID="cri-o://b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2" gracePeriod=2 Jul 09 22:35:38.430884 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:38.430857 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xd878" event={"ID":"10bf1d7a-515b-4179-ab64-394b831f5850","Type":"ContainerStarted","Data":"0bcb8a2ce589b5caf74b2b9ed1abe7f10a99e22e4e98bef3a62c0a5ac07dce05"} Jul 09 22:35:38.445257 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:38.445216 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" podStartSLOduration=1.5075102299999998 podStartE2EDuration="3.445200422s" totalImagesPullingTime="1.937690192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:35:38.444277996 +0000 UTC m=+453.741705307" watchObservedRunningTime="2026-07-09 22:35:38.445200422 +0000 UTC m=+453.742627719" Jul 09 22:35:38.459200 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:38.459142 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xd878" podStartSLOduration=1.180594275 podStartE2EDuration="2.459125866s" totalImagesPullingTime="1.278531591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:35:38.458047038 +0000 UTC m=+453.755474336" watchObservedRunningTime="2026-07-09 22:35:38.459125866 +0000 UTC m=+453.756553163" Jul 09 22:35:38.664981 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:38.664953 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" Jul 09 22:35:38.775991 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:38.775863 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnsjk\" (UniqueName: \"kubernetes.io/projected/2cbd4488-1877-4b6a-8278-77950c9150a0-kube-api-access-mnsjk\") pod \"2cbd4488-1877-4b6a-8278-77950c9150a0\" (UID: \"2cbd4488-1877-4b6a-8278-77950c9150a0\") " Jul 09 22:35:38.778100 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:38.778066 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cbd4488-1877-4b6a-8278-77950c9150a0-kube-api-access-mnsjk" (OuterVolumeSpecName: "kube-api-access-mnsjk") pod "2cbd4488-1877-4b6a-8278-77950c9150a0" (UID: "2cbd4488-1877-4b6a-8278-77950c9150a0"). InnerVolumeSpecName "kube-api-access-mnsjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:35:38.877186 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:38.877148 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnsjk\" (UniqueName: \"kubernetes.io/projected/2cbd4488-1877-4b6a-8278-77950c9150a0-kube-api-access-mnsjk\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:35:39.437023 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:39.436897 2567 generic.go:356] "Generic (PLEG): container finished" podID="2cbd4488-1877-4b6a-8278-77950c9150a0" containerID="b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2" exitCode=0 Jul 09 22:35:39.437023 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:39.436980 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" Jul 09 22:35:39.437023 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:39.436986 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" event={"ID":"2cbd4488-1877-4b6a-8278-77950c9150a0","Type":"ContainerDied","Data":"b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2"} Jul 09 22:35:39.437577 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:39.437041 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nl54t" event={"ID":"2cbd4488-1877-4b6a-8278-77950c9150a0","Type":"ContainerDied","Data":"5ec18995083868bc340bdbbd514e6ecdd9f6871683af30b4d8db9406148e8192"} Jul 09 22:35:39.437577 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:39.437060 2567 scope.go:117] "RemoveContainer" containerID="b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2" Jul 09 22:35:39.446222 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:39.446193 2567 scope.go:117] "RemoveContainer" containerID="b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2" Jul 09 22:35:39.446509 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:35:39.446489 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2\": container with ID starting with b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2 not found: ID does not exist" containerID="b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2" Jul 09 22:35:39.446575 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:39.446523 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2"} err="failed to get container status \"b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2\": rpc error: code = NotFound desc = could not find container \"b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2\": container with ID starting with b2a3487bc5b721e35062d2a9eda4ead77b627e0135f7fe5044beca02417e17f2 not found: ID does not exist" Jul 09 22:35:39.452999 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:39.452974 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nl54t"] Jul 09 22:35:39.454625 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:39.454602 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nl54t"] Jul 09 22:35:41.178330 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:41.178296 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cbd4488-1877-4b6a-8278-77950c9150a0" path="/var/lib/kubelet/pods/2cbd4488-1877-4b6a-8278-77950c9150a0/volumes" Jul 09 22:35:46.485311 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:46.485280 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xd878" Jul 09 22:35:46.485724 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:46.485332 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xd878" Jul 09 22:35:46.507946 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:46.507899 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xd878" Jul 09 22:35:47.497046 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:47.497021 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xd878" Jul 09 22:35:48.305947 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.305899 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64967b6b88-2cp4q"] Jul 09 22:35:48.306328 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.306315 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cbd4488-1877-4b6a-8278-77950c9150a0" containerName="registry-server" Jul 09 22:35:48.306377 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.306330 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cbd4488-1877-4b6a-8278-77950c9150a0" containerName="registry-server" Jul 09 22:35:48.306429 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.306418 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cbd4488-1877-4b6a-8278-77950c9150a0" containerName="registry-server" Jul 09 22:35:48.311046 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.311024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.325971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.325941 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64967b6b88-2cp4q"] Jul 09 22:35:48.371332 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.371293 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd697767-bf26-4e9a-a3f4-3aa3858cf614-console-serving-cert\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.371332 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.371338 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-trusted-ca-bundle\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.371566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.371376 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-console-config\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.371566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.371414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd697767-bf26-4e9a-a3f4-3aa3858cf614-console-oauth-config\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.371566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.371442 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-oauth-serving-cert\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.371566 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.371477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npxnm\" (UniqueName: \"kubernetes.io/projected/cd697767-bf26-4e9a-a3f4-3aa3858cf614-kube-api-access-npxnm\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.371746 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.371600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-service-ca\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.472830 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.472792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-trusted-ca-bundle\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.473048 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.472843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-console-config\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.473048 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.472866 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd697767-bf26-4e9a-a3f4-3aa3858cf614-console-oauth-config\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.473048 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.472884 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-oauth-serving-cert\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.473048 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.472902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npxnm\" (UniqueName: \"kubernetes.io/projected/cd697767-bf26-4e9a-a3f4-3aa3858cf614-kube-api-access-npxnm\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.473048 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.472992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-service-ca\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.473048 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.473012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd697767-bf26-4e9a-a3f4-3aa3858cf614-console-serving-cert\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.473711 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.473688 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-oauth-serving-cert\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.473803 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.473742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-service-ca\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.473846 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.473805 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-console-config\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.474409 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.474386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd697767-bf26-4e9a-a3f4-3aa3858cf614-trusted-ca-bundle\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.475324 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.475305 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd697767-bf26-4e9a-a3f4-3aa3858cf614-console-oauth-config\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.475624 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.475608 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd697767-bf26-4e9a-a3f4-3aa3858cf614-console-serving-cert\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.481106 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.481086 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npxnm\" (UniqueName: \"kubernetes.io/projected/cd697767-bf26-4e9a-a3f4-3aa3858cf614-kube-api-access-npxnm\") pod \"console-64967b6b88-2cp4q\" (UID: \"cd697767-bf26-4e9a-a3f4-3aa3858cf614\") " pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.620448 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.620346 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:48.758035 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:48.758009 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64967b6b88-2cp4q"] Jul 09 22:35:48.760029 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:35:48.759999 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd697767_bf26_4e9a_a3f4_3aa3858cf614.slice/crio-56a979742ae6c18cca4112a20d87897629b6551c4251d77eb64b40fa000cabdc WatchSource:0}: Error finding container 56a979742ae6c18cca4112a20d87897629b6551c4251d77eb64b40fa000cabdc: Status 404 returned error can't find the container with id 56a979742ae6c18cca4112a20d87897629b6551c4251d77eb64b40fa000cabdc Jul 09 22:35:49.487785 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:49.487750 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64967b6b88-2cp4q" event={"ID":"cd697767-bf26-4e9a-a3f4-3aa3858cf614","Type":"ContainerStarted","Data":"696f3542b2ad168ee3da55899e12ec869fe1b3a88a671daede2d3711a149e6e9"} Jul 09 22:35:49.487975 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:49.487796 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64967b6b88-2cp4q" event={"ID":"cd697767-bf26-4e9a-a3f4-3aa3858cf614","Type":"ContainerStarted","Data":"56a979742ae6c18cca4112a20d87897629b6551c4251d77eb64b40fa000cabdc"} Jul 09 22:35:49.506899 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:49.506849 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64967b6b88-2cp4q" podStartSLOduration=1.506831257 podStartE2EDuration="1.506831257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:35:49.504343787 +0000 UTC m=+464.801771097" watchObservedRunningTime="2026-07-09 22:35:49.506831257 +0000 UTC m=+464.804258554" Jul 09 22:35:58.620848 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:58.620802 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:58.621286 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:58.620880 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:58.625645 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:58.625619 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:59.539055 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:59.539024 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64967b6b88-2cp4q" Jul 09 22:35:59.589425 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:35:59.589388 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b9b7dfc5-gpxdw"] Jul 09 22:36:15.671580 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:15.671538 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv"] Jul 09 22:36:15.679987 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:15.679958 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:15.685557 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:15.685534 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7g5xg\"" Jul 09 22:36:15.689157 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:15.689136 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv"] Jul 09 22:36:15.742477 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:15.742439 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b6gn\" (UniqueName: \"kubernetes.io/projected/8d3e2217-d7cc-40e3-8a05-1660cc82d376-kube-api-access-6b6gn\") pod \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" (UID: \"8d3e2217-d7cc-40e3-8a05-1660cc82d376\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:15.843239 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:15.843195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b6gn\" (UniqueName: \"kubernetes.io/projected/8d3e2217-d7cc-40e3-8a05-1660cc82d376-kube-api-access-6b6gn\") pod \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" (UID: \"8d3e2217-d7cc-40e3-8a05-1660cc82d376\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:15.854256 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:15.854217 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b6gn\" (UniqueName: \"kubernetes.io/projected/8d3e2217-d7cc-40e3-8a05-1660cc82d376-kube-api-access-6b6gn\") pod \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" (UID: \"8d3e2217-d7cc-40e3-8a05-1660cc82d376\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:15.990745 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:15.990643 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:16.135937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:16.135897 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv"] Jul 09 22:36:16.137957 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:36:16.137929 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3e2217_d7cc_40e3_8a05_1660cc82d376.slice/crio-319b298d6ddf55a0321ddf69c8b714dcd08562844ffcf1fc7acd51210bed36f4 WatchSource:0}: Error finding container 319b298d6ddf55a0321ddf69c8b714dcd08562844ffcf1fc7acd51210bed36f4: Status 404 returned error can't find the container with id 319b298d6ddf55a0321ddf69c8b714dcd08562844ffcf1fc7acd51210bed36f4 Jul 09 22:36:16.617282 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:16.617242 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" event={"ID":"8d3e2217-d7cc-40e3-8a05-1660cc82d376","Type":"ContainerStarted","Data":"319b298d6ddf55a0321ddf69c8b714dcd08562844ffcf1fc7acd51210bed36f4"} Jul 09 22:36:18.629109 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:18.629078 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" event={"ID":"8d3e2217-d7cc-40e3-8a05-1660cc82d376","Type":"ContainerStarted","Data":"0a0b86ad5131c7473eb1eac494539c882798ddd7e67709c9746bbc1815adff7e"} Jul 09 22:36:18.629585 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:18.629188 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:18.657449 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:18.657400 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" podStartSLOduration=1.982615616 podStartE2EDuration="3.65738343s" totalImagesPullingTime="1.674767814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:18.654658142 +0000 UTC m=+493.952085442" watchObservedRunningTime="2026-07-09 22:36:18.65738343 +0000 UTC m=+493.954810729" Jul 09 22:36:24.613798 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.613757 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b9b7dfc5-gpxdw" podUID="7cea9aae-2f9b-4fe6-9e86-2f9681884c92" containerName="console" containerID="cri-o://3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27" gracePeriod=15 Jul 09 22:36:24.857166 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.857138 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:36:24.936729 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.936629 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-trusted-ca-bundle\") pod \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " Jul 09 22:36:24.936729 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.936703 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-oauth-config\") pod \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " Jul 09 22:36:24.937014 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.936746 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-oauth-serving-cert\") pod \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " Jul 09 22:36:24.937014 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.936785 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-serving-cert\") pod \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " Jul 09 22:36:24.937014 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.936826 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-config\") pod \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " Jul 09 22:36:24.937014 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.936865 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph6zx\" (UniqueName: \"kubernetes.io/projected/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-kube-api-access-ph6zx\") pod \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " Jul 09 22:36:24.937014 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.936890 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-service-ca\") pod \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\" (UID: \"7cea9aae-2f9b-4fe6-9e86-2f9681884c92\") " Jul 09 22:36:24.937294 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.937263 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7cea9aae-2f9b-4fe6-9e86-2f9681884c92" (UID: "7cea9aae-2f9b-4fe6-9e86-2f9681884c92"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:36:24.937468 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.937298 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7cea9aae-2f9b-4fe6-9e86-2f9681884c92" (UID: "7cea9aae-2f9b-4fe6-9e86-2f9681884c92"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:36:24.937468 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.937391 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-config" (OuterVolumeSpecName: "console-config") pod "7cea9aae-2f9b-4fe6-9e86-2f9681884c92" (UID: "7cea9aae-2f9b-4fe6-9e86-2f9681884c92"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:36:24.937468 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.937413 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-service-ca" (OuterVolumeSpecName: "service-ca") pod "7cea9aae-2f9b-4fe6-9e86-2f9681884c92" (UID: "7cea9aae-2f9b-4fe6-9e86-2f9681884c92"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:36:24.938929 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.938880 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7cea9aae-2f9b-4fe6-9e86-2f9681884c92" (UID: "7cea9aae-2f9b-4fe6-9e86-2f9681884c92"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:36:24.939044 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.939025 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-kube-api-access-ph6zx" (OuterVolumeSpecName: "kube-api-access-ph6zx") pod "7cea9aae-2f9b-4fe6-9e86-2f9681884c92" (UID: "7cea9aae-2f9b-4fe6-9e86-2f9681884c92"). InnerVolumeSpecName "kube-api-access-ph6zx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:36:24.939142 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.939122 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7cea9aae-2f9b-4fe6-9e86-2f9681884c92" (UID: "7cea9aae-2f9b-4fe6-9e86-2f9681884c92"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:36:24.993054 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.992995 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777"] Jul 09 22:36:24.993477 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.993459 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cea9aae-2f9b-4fe6-9e86-2f9681884c92" containerName="console" Jul 09 22:36:24.993568 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.993480 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cea9aae-2f9b-4fe6-9e86-2f9681884c92" containerName="console" Jul 09 22:36:24.993568 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.993564 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cea9aae-2f9b-4fe6-9e86-2f9681884c92" containerName="console" Jul 09 22:36:24.996959 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:24.996937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:25.000224 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.000203 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2vbvv\"" Jul 09 22:36:25.015862 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.015833 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777"] Jul 09 22:36:25.038564 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.038527 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-oauth-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:25.038778 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.038574 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-serving-cert\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:25.038778 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.038591 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:25.038778 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.038606 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph6zx\" (UniqueName: \"kubernetes.io/projected/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-kube-api-access-ph6zx\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:25.038778 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.038628 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-service-ca\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:25.038778 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.038643 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-trusted-ca-bundle\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:25.038778 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.038656 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cea9aae-2f9b-4fe6-9e86-2f9681884c92-console-oauth-config\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:25.139699 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.139662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j9k9\" (UniqueName: \"kubernetes.io/projected/9979df03-359b-4821-9786-4884f5f3e8a0-kube-api-access-5j9k9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td777\" (UID: \"9979df03-359b-4821-9786-4884f5f3e8a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:25.139894 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.139750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9979df03-359b-4821-9786-4884f5f3e8a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td777\" (UID: \"9979df03-359b-4821-9786-4884f5f3e8a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:25.241273 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.241171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9979df03-359b-4821-9786-4884f5f3e8a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td777\" (UID: \"9979df03-359b-4821-9786-4884f5f3e8a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:25.241273 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.241224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9k9\" (UniqueName: \"kubernetes.io/projected/9979df03-359b-4821-9786-4884f5f3e8a0-kube-api-access-5j9k9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td777\" (UID: \"9979df03-359b-4821-9786-4884f5f3e8a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:25.241597 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.241577 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9979df03-359b-4821-9786-4884f5f3e8a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td777\" (UID: \"9979df03-359b-4821-9786-4884f5f3e8a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:25.251019 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.250991 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9k9\" (UniqueName: \"kubernetes.io/projected/9979df03-359b-4821-9786-4884f5f3e8a0-kube-api-access-5j9k9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td777\" (UID: \"9979df03-359b-4821-9786-4884f5f3e8a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:25.307831 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.307794 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:25.460946 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.460900 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777"] Jul 09 22:36:25.464194 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:36:25.464162 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9979df03_359b_4821_9786_4884f5f3e8a0.slice/crio-700b31ae50e91f73fa5d8bbbcb71fdf61624f84439300f7a2a688f9ead5d6677 WatchSource:0}: Error finding container 700b31ae50e91f73fa5d8bbbcb71fdf61624f84439300f7a2a688f9ead5d6677: Status 404 returned error can't find the container with id 700b31ae50e91f73fa5d8bbbcb71fdf61624f84439300f7a2a688f9ead5d6677 Jul 09 22:36:25.669874 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.669838 2567 generic.go:356] "Generic (PLEG): container finished" podID="7cea9aae-2f9b-4fe6-9e86-2f9681884c92" containerID="3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27" exitCode=0 Jul 09 22:36:25.670388 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.669933 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9b7dfc5-gpxdw" Jul 09 22:36:25.670388 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.669948 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9b7dfc5-gpxdw" event={"ID":"7cea9aae-2f9b-4fe6-9e86-2f9681884c92","Type":"ContainerDied","Data":"3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27"} Jul 09 22:36:25.670388 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.670035 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9b7dfc5-gpxdw" event={"ID":"7cea9aae-2f9b-4fe6-9e86-2f9681884c92","Type":"ContainerDied","Data":"74616bc00e50f1884e71a7520def5c803ce78f24c105c07067cbb8f835174044"} Jul 09 22:36:25.670388 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.670060 2567 scope.go:117] "RemoveContainer" containerID="3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27" Jul 09 22:36:25.671495 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.671350 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" event={"ID":"9979df03-359b-4821-9786-4884f5f3e8a0","Type":"ContainerStarted","Data":"700b31ae50e91f73fa5d8bbbcb71fdf61624f84439300f7a2a688f9ead5d6677"} Jul 09 22:36:25.678411 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.678391 2567 scope.go:117] "RemoveContainer" containerID="3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27" Jul 09 22:36:25.678690 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:25.678671 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27\": container with ID starting with 3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27 not found: ID does not exist" containerID="3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27" Jul 09 22:36:25.678742 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.678698 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27"} err="failed to get container status \"3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27\": rpc error: code = NotFound desc = could not find container \"3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27\": container with ID starting with 3cc0a47021715ab5973d27f412da69c8da612a04cd6f5d22aef3fe854f1adf27 not found: ID does not exist" Jul 09 22:36:25.700184 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.700156 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b9b7dfc5-gpxdw"] Jul 09 22:36:25.703848 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:25.703821 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b9b7dfc5-gpxdw"] Jul 09 22:36:27.178799 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:27.178759 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cea9aae-2f9b-4fe6-9e86-2f9681884c92" path="/var/lib/kubelet/pods/7cea9aae-2f9b-4fe6-9e86-2f9681884c92/volumes" Jul 09 22:36:29.637145 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:29.637118 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:31.707707 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:31.707663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" event={"ID":"9979df03-359b-4821-9786-4884f5f3e8a0","Type":"ContainerStarted","Data":"2c4c90974c6b85dedada26e983d0c4f98a4440e27658a8b4e40898a1806a2f23"} Jul 09 22:36:31.708198 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:31.707750 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:31.741274 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:31.741219 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" podStartSLOduration=2.356786207 podStartE2EDuration="7.741201196s" totalImagesPullingTime="5.384414989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:31.73925274 +0000 UTC m=+507.036680038" watchObservedRunningTime="2026-07-09 22:36:31.741201196 +0000 UTC m=+507.038628494" Jul 09 22:36:42.714958 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:42.714900 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.524855 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.524817 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb"] Jul 09 22:36:44.528579 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.528559 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.529003 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.528982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m55s\" (UniqueName: \"kubernetes.io/projected/4d89b366-065f-40e0-b3f2-60808de5a880-kube-api-access-9m55s\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" (UID: \"4d89b366-065f-40e0-b3f2-60808de5a880\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.529075 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.529035 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d89b366-065f-40e0-b3f2-60808de5a880-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" (UID: \"4d89b366-065f-40e0-b3f2-60808de5a880\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.542704 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.542683 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb"] Jul 09 22:36:44.586896 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.586841 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777"] Jul 09 22:36:44.587100 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.587077 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" containerName="manager" containerID="cri-o://2c4c90974c6b85dedada26e983d0c4f98a4440e27658a8b4e40898a1806a2f23" gracePeriod=2 Jul 09 22:36:44.589353 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.589326 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777"] Jul 09 22:36:44.589682 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.589660 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td777\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.599321 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.599296 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb"] Jul 09 22:36:44.599578 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.599559 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-9m55s], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" podUID="4d89b366-065f-40e0-b3f2-60808de5a880" Jul 09 22:36:44.611668 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.611544 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb"] Jul 09 22:36:44.624806 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.624775 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv"] Jul 09 22:36:44.625164 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.625051 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" containerName="manager" containerID="cri-o://0a0b86ad5131c7473eb1eac494539c882798ddd7e67709c9746bbc1815adff7e" gracePeriod=2 Jul 09 22:36:44.628559 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.628524 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8"] Jul 09 22:36:44.628988 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.628970 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" containerName="manager" Jul 09 22:36:44.628988 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.628988 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" containerName="manager" Jul 09 22:36:44.629551 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.629128 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" containerName="manager" Jul 09 22:36:44.629749 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.629712 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td777\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.630084 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.629894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m55s\" (UniqueName: \"kubernetes.io/projected/4d89b366-065f-40e0-b3f2-60808de5a880-kube-api-access-9m55s\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" (UID: \"4d89b366-065f-40e0-b3f2-60808de5a880\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.630084 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.629976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d89b366-065f-40e0-b3f2-60808de5a880-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" (UID: \"4d89b366-065f-40e0-b3f2-60808de5a880\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.630498 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.630480 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d89b366-065f-40e0-b3f2-60808de5a880-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" (UID: \"4d89b366-065f-40e0-b3f2-60808de5a880\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.632707 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.632688 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:44.635047 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.635023 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9m55s for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-tpbsb" not found Jul 09 22:36:44.635149 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.635106 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d89b366-065f-40e0-b3f2-60808de5a880-kube-api-access-9m55s podName:4d89b366-065f-40e0-b3f2-60808de5a880 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:45.135085434 +0000 UTC m=+520.432512713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9m55s" (UniqueName: "kubernetes.io/projected/4d89b366-065f-40e0-b3f2-60808de5a880-kube-api-access-9m55s") pod "kuadrant-operator-controller-manager-86878c769f-tpbsb" (UID: "4d89b366-065f-40e0-b3f2-60808de5a880") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-tpbsb" not found Jul 09 22:36:44.639490 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.639463 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv"] Jul 09 22:36:44.648642 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.648613 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8"] Jul 09 22:36:44.652175 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.652153 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh"] Jul 09 22:36:44.652654 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.652615 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" containerName="manager" Jul 09 22:36:44.652654 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.652632 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" containerName="manager" Jul 09 22:36:44.652825 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.652722 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" containerName="manager" Jul 09 22:36:44.655844 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.655825 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" Jul 09 22:36:44.668272 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.668241 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh"] Jul 09 22:36:44.673999 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.673961 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:44.675794 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.675759 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td777\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.702456 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.702414 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:44.704882 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.704854 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td777\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.730812 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.730785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f9890f5-6315-4ef4-ab1a-637433718f35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lk9b8\" (UID: \"3f9890f5-6315-4ef4-ab1a-637433718f35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:44.730971 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.730825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6n4d\" (UniqueName: \"kubernetes.io/projected/3f9890f5-6315-4ef4-ab1a-637433718f35-kube-api-access-b6n4d\") pod \"kuadrant-operator-controller-manager-86878c769f-lk9b8\" (UID: \"3f9890f5-6315-4ef4-ab1a-637433718f35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:44.773690 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.773658 2567 generic.go:356] "Generic (PLEG): container finished" podID="9979df03-359b-4821-9786-4884f5f3e8a0" containerID="2c4c90974c6b85dedada26e983d0c4f98a4440e27658a8b4e40898a1806a2f23" exitCode=0 Jul 09 22:36:44.775330 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.775200 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" containerID="0a0b86ad5131c7473eb1eac494539c882798ddd7e67709c9746bbc1815adff7e" exitCode=0 Jul 09 22:36:44.775330 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.775325 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.777428 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.777400 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="4d89b366-065f-40e0-b3f2-60808de5a880" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.779219 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.779192 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:44.780855 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.780823 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td777\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.783442 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.783421 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.785568 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.785538 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="4d89b366-065f-40e0-b3f2-60808de5a880" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.787483 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.787459 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:44.789295 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.789275 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td777\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.832365 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.832334 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d89b366-065f-40e0-b3f2-60808de5a880-extensions-socket-volume\") pod \"4d89b366-065f-40e0-b3f2-60808de5a880\" (UID: \"4d89b366-065f-40e0-b3f2-60808de5a880\") " Jul 09 22:36:44.832528 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.832509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f9890f5-6315-4ef4-ab1a-637433718f35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lk9b8\" (UID: \"3f9890f5-6315-4ef4-ab1a-637433718f35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:44.832580 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.832556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6n4d\" (UniqueName: \"kubernetes.io/projected/3f9890f5-6315-4ef4-ab1a-637433718f35-kube-api-access-b6n4d\") pod \"kuadrant-operator-controller-manager-86878c769f-lk9b8\" (UID: \"3f9890f5-6315-4ef4-ab1a-637433718f35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:44.832631 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.832577 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d89b366-065f-40e0-b3f2-60808de5a880-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d89b366-065f-40e0-b3f2-60808de5a880" (UID: "4d89b366-065f-40e0-b3f2-60808de5a880"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:36:44.832714 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.832692 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwm8j\" (UniqueName: \"kubernetes.io/projected/8d3f566e-4754-4a3d-9ce1-ea3939b1b01c-kube-api-access-gwm8j\") pod \"limitador-operator-controller-manager-859d7b78bd-bgddh\" (UID: \"8d3f566e-4754-4a3d-9ce1-ea3939b1b01c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" Jul 09 22:36:44.832850 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.832832 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m55s\" (UniqueName: \"kubernetes.io/projected/4d89b366-065f-40e0-b3f2-60808de5a880-kube-api-access-9m55s\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:44.832953 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.832851 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d89b366-065f-40e0-b3f2-60808de5a880-extensions-socket-volume\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:44.833016 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.832965 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f9890f5-6315-4ef4-ab1a-637433718f35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lk9b8\" (UID: \"3f9890f5-6315-4ef4-ab1a-637433718f35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:44.846009 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.845981 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6n4d\" (UniqueName: \"kubernetes.io/projected/3f9890f5-6315-4ef4-ab1a-637433718f35-kube-api-access-b6n4d\") pod \"kuadrant-operator-controller-manager-86878c769f-lk9b8\" (UID: \"3f9890f5-6315-4ef4-ab1a-637433718f35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:44.872849 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.872825 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.875128 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.875095 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="4d89b366-065f-40e0-b3f2-60808de5a880" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.875557 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.875544 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:44.877475 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.877452 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:44.879556 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.879536 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td777\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.881590 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.881570 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="4d89b366-065f-40e0-b3f2-60808de5a880" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:44.883473 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.883454 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:44.885425 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:44.885406 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td777\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:44.933881 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.933845 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9979df03-359b-4821-9786-4884f5f3e8a0-extensions-socket-volume\") pod \"9979df03-359b-4821-9786-4884f5f3e8a0\" (UID: \"9979df03-359b-4821-9786-4884f5f3e8a0\") " Jul 09 22:36:44.934073 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.933889 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j9k9\" (UniqueName: \"kubernetes.io/projected/9979df03-359b-4821-9786-4884f5f3e8a0-kube-api-access-5j9k9\") pod \"9979df03-359b-4821-9786-4884f5f3e8a0\" (UID: \"9979df03-359b-4821-9786-4884f5f3e8a0\") " Jul 09 22:36:44.934073 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.933945 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b6gn\" (UniqueName: \"kubernetes.io/projected/8d3e2217-d7cc-40e3-8a05-1660cc82d376-kube-api-access-6b6gn\") pod \"8d3e2217-d7cc-40e3-8a05-1660cc82d376\" (UID: \"8d3e2217-d7cc-40e3-8a05-1660cc82d376\") " Jul 09 22:36:44.934210 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.934189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwm8j\" (UniqueName: \"kubernetes.io/projected/8d3f566e-4754-4a3d-9ce1-ea3939b1b01c-kube-api-access-gwm8j\") pod \"limitador-operator-controller-manager-859d7b78bd-bgddh\" (UID: \"8d3f566e-4754-4a3d-9ce1-ea3939b1b01c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" Jul 09 22:36:44.934463 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.934432 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9979df03-359b-4821-9786-4884f5f3e8a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9979df03-359b-4821-9786-4884f5f3e8a0" (UID: "9979df03-359b-4821-9786-4884f5f3e8a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:36:44.936121 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.936100 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9979df03-359b-4821-9786-4884f5f3e8a0-kube-api-access-5j9k9" (OuterVolumeSpecName: "kube-api-access-5j9k9") pod "9979df03-359b-4821-9786-4884f5f3e8a0" (UID: "9979df03-359b-4821-9786-4884f5f3e8a0"). InnerVolumeSpecName "kube-api-access-5j9k9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:36:44.936268 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.936127 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d3e2217-d7cc-40e3-8a05-1660cc82d376-kube-api-access-6b6gn" (OuterVolumeSpecName: "kube-api-access-6b6gn") pod "8d3e2217-d7cc-40e3-8a05-1660cc82d376" (UID: "8d3e2217-d7cc-40e3-8a05-1660cc82d376"). InnerVolumeSpecName "kube-api-access-6b6gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:36:44.944655 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:44.944631 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwm8j\" (UniqueName: \"kubernetes.io/projected/8d3f566e-4754-4a3d-9ce1-ea3939b1b01c-kube-api-access-gwm8j\") pod \"limitador-operator-controller-manager-859d7b78bd-bgddh\" (UID: \"8d3f566e-4754-4a3d-9ce1-ea3939b1b01c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" Jul 09 22:36:45.012736 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.012698 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:45.018979 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.018957 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" Jul 09 22:36:45.035616 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.035579 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9979df03-359b-4821-9786-4884f5f3e8a0-extensions-socket-volume\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:45.035751 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.035617 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j9k9\" (UniqueName: \"kubernetes.io/projected/9979df03-359b-4821-9786-4884f5f3e8a0-kube-api-access-5j9k9\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:45.035751 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.035636 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b6gn\" (UniqueName: \"kubernetes.io/projected/8d3e2217-d7cc-40e3-8a05-1660cc82d376-kube-api-access-6b6gn\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:36:45.177934 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:45.177878 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="4d89b366-065f-40e0-b3f2-60808de5a880" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:45.180045 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.180020 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d89b366-065f-40e0-b3f2-60808de5a880" path="/var/lib/kubelet/pods/4d89b366-065f-40e0-b3f2-60808de5a880/volumes" Jul 09 22:36:45.180173 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:45.180053 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ggmqv\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:45.180304 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.180290 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d3e2217-d7cc-40e3-8a05-1660cc82d376" path="/var/lib/kubelet/pods/8d3e2217-d7cc-40e3-8a05-1660cc82d376/volumes" Jul 09 22:36:45.180643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.180629 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" path="/var/lib/kubelet/pods/9979df03-359b-4821-9786-4884f5f3e8a0/volumes" Jul 09 22:36:45.182081 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:45.182051 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td777\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="9979df03-359b-4821-9786-4884f5f3e8a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:45.192019 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.191995 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8"] Jul 09 22:36:45.193700 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:36:45.193681 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9890f5_6315_4ef4_ab1a_637433718f35.slice/crio-bf6197ffbb349b412c9bff50b05d30e0e95a7f040c1a4388b31176fccf0d91bd WatchSource:0}: Error finding container bf6197ffbb349b412c9bff50b05d30e0e95a7f040c1a4388b31176fccf0d91bd: Status 404 returned error can't find the container with id bf6197ffbb349b412c9bff50b05d30e0e95a7f040c1a4388b31176fccf0d91bd Jul 09 22:36:45.204844 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.204822 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh"] Jul 09 22:36:45.207642 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:36:45.207615 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3f566e_4754_4a3d_9ce1_ea3939b1b01c.slice/crio-81f790fcaaf1c6e45791eef02eb2e395656ab2249010e4b473c97a73b4a58727 WatchSource:0}: Error finding container 81f790fcaaf1c6e45791eef02eb2e395656ab2249010e4b473c97a73b4a58727: Status 404 returned error can't find the container with id 81f790fcaaf1c6e45791eef02eb2e395656ab2249010e4b473c97a73b4a58727 Jul 09 22:36:45.782376 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.782339 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" event={"ID":"8d3f566e-4754-4a3d-9ce1-ea3939b1b01c","Type":"ContainerStarted","Data":"806c43517ba34e5291bd656d7acd8616c2fe4d589bc8190af4a6a6a5bb059bcf"} Jul 09 22:36:45.782861 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.782430 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" Jul 09 22:36:45.782861 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.782454 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" event={"ID":"8d3f566e-4754-4a3d-9ce1-ea3939b1b01c","Type":"ContainerStarted","Data":"81f790fcaaf1c6e45791eef02eb2e395656ab2249010e4b473c97a73b4a58727"} Jul 09 22:36:45.784081 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.784055 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" event={"ID":"3f9890f5-6315-4ef4-ab1a-637433718f35","Type":"ContainerStarted","Data":"8824f38f143904ed664487b4f2de924a4d2a36dc0d83302a1eff81494051e38a"} Jul 09 22:36:45.784188 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.784109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" event={"ID":"3f9890f5-6315-4ef4-ab1a-637433718f35","Type":"ContainerStarted","Data":"bf6197ffbb349b412c9bff50b05d30e0e95a7f040c1a4388b31176fccf0d91bd"} Jul 09 22:36:45.784188 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.784153 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:45.785346 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.785331 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td777" Jul 09 22:36:45.786259 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.785330 2567 scope.go:117] "RemoveContainer" containerID="2c4c90974c6b85dedada26e983d0c4f98a4440e27658a8b4e40898a1806a2f23" Jul 09 22:36:45.786745 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.786729 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:45.786861 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.786750 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ggmqv" Jul 09 22:36:45.796091 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.796067 2567 scope.go:117] "RemoveContainer" containerID="0a0b86ad5131c7473eb1eac494539c882798ddd7e67709c9746bbc1815adff7e" Jul 09 22:36:45.814495 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:45.814446 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" podStartSLOduration=1.814429673 podStartE2EDuration="1.814429673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:45.812413603 +0000 UTC m=+521.109840901" watchObservedRunningTime="2026-07-09 22:36:45.814429673 +0000 UTC m=+521.111856971" Jul 09 22:36:45.815513 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:36:45.815477 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-tpbsb\" is forbidden: User \"system:node:ip-10-0-136-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-228.ec2.internal' and this object" podUID="4d89b366-065f-40e0-b3f2-60808de5a880" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbsb" Jul 09 22:36:56.796537 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:56.796452 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgddh" Jul 09 22:36:56.796537 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:56.796534 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" Jul 09 22:36:56.818559 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:36:56.818501 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk9b8" podStartSLOduration=12.818483913 podStartE2EDuration="12.818483913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:45.8442598 +0000 UTC m=+521.141687098" watchObservedRunningTime="2026-07-09 22:36:56.818483913 +0000 UTC m=+532.115911211" Jul 09 22:37:13.171672 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.171638 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k"] Jul 09 22:37:13.175319 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.175289 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.177977 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.177954 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gmhlz\"" Jul 09 22:37:13.190823 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.190794 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k"] Jul 09 22:37:13.312088 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.312050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9rz7\" (UniqueName: \"kubernetes.io/projected/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-kube-api-access-p9rz7\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.312088 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.312087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.312301 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.312109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.312301 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.312193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.312301 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.312242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.312301 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.312294 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.312437 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.312336 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.312437 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.312367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.312437 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.312418 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.413459 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.413639 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413486 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.413639 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413521 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.413639 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.413639 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413589 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9rz7\" (UniqueName: \"kubernetes.io/projected/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-kube-api-access-p9rz7\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.413639 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.413639 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.414002 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413680 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.414002 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.414002 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.414002 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.413943 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.414316 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.414285 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.414392 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.414336 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.414392 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.414378 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.415995 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.415974 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.416302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.416282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.424397 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.424323 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.424515 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.424433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9rz7\" (UniqueName: \"kubernetes.io/projected/5c3ad29f-2d96-4854-adf5-f5efe874bc4e-kube-api-access-p9rz7\") pod \"maas-default-gateway-openshift-default-56654dcf7-9649k\" (UID: \"5c3ad29f-2d96-4854-adf5-f5efe874bc4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.485401 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.485361 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:13.622221 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.622195 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k"] Jul 09 22:37:13.626249 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:37:13.626220 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3ad29f_2d96_4854_adf5_f5efe874bc4e.slice/crio-a3a1351cd36a4104c6c1b7a2bce02439eb2d285df3baa240d6f120d202f023d1 WatchSource:0}: Error finding container a3a1351cd36a4104c6c1b7a2bce02439eb2d285df3baa240d6f120d202f023d1: Status 404 returned error can't find the container with id a3a1351cd36a4104c6c1b7a2bce02439eb2d285df3baa240d6f120d202f023d1 Jul 09 22:37:13.629075 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.629042 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:37:13.629146 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.629128 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:37:13.629183 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.629170 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:37:13.931212 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.931117 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" event={"ID":"5c3ad29f-2d96-4854-adf5-f5efe874bc4e","Type":"ContainerStarted","Data":"9aec159ed17dabaced69362cac6e4cc33ebe0aa5ad46e4590382d1256bfa9624"} Jul 09 22:37:13.931212 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.931176 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" event={"ID":"5c3ad29f-2d96-4854-adf5-f5efe874bc4e","Type":"ContainerStarted","Data":"a3a1351cd36a4104c6c1b7a2bce02439eb2d285df3baa240d6f120d202f023d1"} Jul 09 22:37:13.952591 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:13.952541 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" podStartSLOduration=0.952524957 podStartE2EDuration="952.524957ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:13.951658908 +0000 UTC m=+549.249086207" watchObservedRunningTime="2026-07-09 22:37:13.952524957 +0000 UTC m=+549.249952309" Jul 09 22:37:14.485947 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:14.485900 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:14.491142 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:14.491115 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:14.937606 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:14.937577 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:14.938622 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:14.938589 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:37:15.261643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.261564 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:37:15.264403 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.264375 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:37:15.266663 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.266639 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qjbs5\"" Jul 09 22:37:15.266796 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.266639 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 22:37:15.275167 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.275141 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:37:15.306369 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.306337 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:37:15.435165 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.435135 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbbbd\" (UniqueName: \"kubernetes.io/projected/f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d-kube-api-access-bbbbd\") pod \"limitador-limitador-54d6d988d5-lcslq\" (UID: \"f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:37:15.435343 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.435176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d-config-file\") pod \"limitador-limitador-54d6d988d5-lcslq\" (UID: \"f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:37:15.535709 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.535686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbbd\" (UniqueName: \"kubernetes.io/projected/f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d-kube-api-access-bbbbd\") pod \"limitador-limitador-54d6d988d5-lcslq\" (UID: \"f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:37:15.536122 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.535728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d-config-file\") pod \"limitador-limitador-54d6d988d5-lcslq\" (UID: \"f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:37:15.536347 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.536328 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d-config-file\") pod \"limitador-limitador-54d6d988d5-lcslq\" (UID: \"f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:37:15.543871 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.543847 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbbbd\" (UniqueName: \"kubernetes.io/projected/f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d-kube-api-access-bbbbd\") pod \"limitador-limitador-54d6d988d5-lcslq\" (UID: \"f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:37:15.580467 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.580431 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:37:15.722050 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.722023 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:37:15.724886 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:37:15.724854 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5623cb1_81f7_4dfa_9632_b9d1bdd8f67d.slice/crio-2b5749598ee58137b72676f05fa2ca05a71d398312a6d817419ff49650d52f8b WatchSource:0}: Error finding container 2b5749598ee58137b72676f05fa2ca05a71d398312a6d817419ff49650d52f8b: Status 404 returned error can't find the container with id 2b5749598ee58137b72676f05fa2ca05a71d398312a6d817419ff49650d52f8b Jul 09 22:37:15.943316 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:15.943219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" event={"ID":"f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d","Type":"ContainerStarted","Data":"2b5749598ee58137b72676f05fa2ca05a71d398312a6d817419ff49650d52f8b"} Jul 09 22:37:18.962541 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:18.962507 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" event={"ID":"f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d","Type":"ContainerStarted","Data":"6ca8f14d7fcdf2f8fe11abdb2da2881ad52ce6d4146dd3bc923e0c84aea761f6"} Jul 09 22:37:18.963092 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:18.962682 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:37:18.979797 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:18.979748 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" podStartSLOduration=1.534243531 podStartE2EDuration="3.979731505s" totalImagesPullingTime="2.445487974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:18.978761045 +0000 UTC m=+554.276188345" watchObservedRunningTime="2026-07-09 22:37:18.979731505 +0000 UTC m=+554.277158802" Jul 09 22:37:29.968805 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:37:29.968777 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lcslq" Jul 09 22:38:30.119997 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:30.119898 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:38:38.365113 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:38.365078 2567 generic.go:356] "Generic (PLEG): container finished" podID="5c3ad29f-2d96-4854-adf5-f5efe874bc4e" containerID="9aec159ed17dabaced69362cac6e4cc33ebe0aa5ad46e4590382d1256bfa9624" exitCode=0 Jul 09 22:38:38.365561 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:38.365150 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" event={"ID":"5c3ad29f-2d96-4854-adf5-f5efe874bc4e","Type":"ContainerDied","Data":"9aec159ed17dabaced69362cac6e4cc33ebe0aa5ad46e4590382d1256bfa9624"} Jul 09 22:38:38.365561 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:38.365548 2567 scope.go:117] "RemoveContainer" containerID="9aec159ed17dabaced69362cac6e4cc33ebe0aa5ad46e4590382d1256bfa9624" Jul 09 22:38:38.366500 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:38.366475 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:38:38.366569 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:38.366556 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:38:38.366614 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:38.366592 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:38:39.371855 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:39.371818 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" event={"ID":"5c3ad29f-2d96-4854-adf5-f5efe874bc4e","Type":"ContainerStarted","Data":"8f67d01aa0f11f21b57c6f4b20b56ae7c51d92e596eca154d3b63be5e8a7b2bb"} Jul 09 22:38:39.485847 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:39.485807 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:38:39.486096 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:39.486069 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9649k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 09 22:38:39.486170 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:39.486129 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" podUID="5c3ad29f-2d96-4854-adf5-f5efe874bc4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 09 22:38:40.486643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:40.486608 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9649k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 09 22:38:40.487062 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:40.486686 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" podUID="5c3ad29f-2d96-4854-adf5-f5efe874bc4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 09 22:38:41.485747 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:41.485708 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9649k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 09 22:38:41.485965 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:41.485765 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" podUID="5c3ad29f-2d96-4854-adf5-f5efe874bc4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 09 22:38:42.485942 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:42.485873 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9649k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 09 22:38:42.486356 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:42.485966 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" podUID="5c3ad29f-2d96-4854-adf5-f5efe874bc4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 09 22:38:43.489422 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:43.489388 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:38:43.489870 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:43.489681 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:38:43.490478 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:43.490459 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9649k" Jul 09 22:38:44.191820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:44.191787 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:38:47.467057 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:38:47.467020 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:39:12.379462 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:39:12.379430 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:39:21.276594 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:39:21.276557 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:39:31.491228 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:39:31.491189 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:39:38.285531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:39:38.285491 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:41:06.873714 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:41:06.873677 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:41:15.673048 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:41:15.673011 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:41:42.178259 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:41:42.178182 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:41:53.779441 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:41:53.779409 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:42:27.969680 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:42:27.969640 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:42:40.172628 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:42:40.172590 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:43:12.685746 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:43:12.685707 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:43:24.875493 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:43:24.875450 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:44:19.292514 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:44:19.292477 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:44:42.973632 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:44:42.973539 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:44:55.478056 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:44:55.478023 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:45:00.148247 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.148207 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb"] Jul 09 22:45:00.151892 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.151865 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" Jul 09 22:45:00.154626 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.154605 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 22:45:00.154751 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.154609 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 22:45:00.155416 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.155403 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mpfsd\"" Jul 09 22:45:00.159518 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.159487 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb"] Jul 09 22:45:00.273564 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.273537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zh6q\" (UniqueName: \"kubernetes.io/projected/95056ed2-d4bc-43e8-a5c5-5a06ea781e6b-kube-api-access-9zh6q\") pod \"maas-api-key-cleanup-29727285-rp4wb\" (UID: \"95056ed2-d4bc-43e8-a5c5-5a06ea781e6b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" Jul 09 22:45:00.375098 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.375042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zh6q\" (UniqueName: \"kubernetes.io/projected/95056ed2-d4bc-43e8-a5c5-5a06ea781e6b-kube-api-access-9zh6q\") pod \"maas-api-key-cleanup-29727285-rp4wb\" (UID: \"95056ed2-d4bc-43e8-a5c5-5a06ea781e6b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" Jul 09 22:45:00.384643 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.384598 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zh6q\" (UniqueName: \"kubernetes.io/projected/95056ed2-d4bc-43e8-a5c5-5a06ea781e6b-kube-api-access-9zh6q\") pod \"maas-api-key-cleanup-29727285-rp4wb\" (UID: \"95056ed2-d4bc-43e8-a5c5-5a06ea781e6b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" Jul 09 22:45:00.466808 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.466721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" Jul 09 22:45:00.611780 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.611651 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb"] Jul 09 22:45:00.614083 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:45:00.614045 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95056ed2_d4bc_43e8_a5c5_5a06ea781e6b.slice/crio-9d3515cc70cfea80497d7dbb6ae7a98efb0e1c7efb31358a8be157ca219d08ff WatchSource:0}: Error finding container 9d3515cc70cfea80497d7dbb6ae7a98efb0e1c7efb31358a8be157ca219d08ff: Status 404 returned error can't find the container with id 9d3515cc70cfea80497d7dbb6ae7a98efb0e1c7efb31358a8be157ca219d08ff Jul 09 22:45:00.616337 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:00.616317 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 22:45:01.285811 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:01.285777 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" event={"ID":"95056ed2-d4bc-43e8-a5c5-5a06ea781e6b","Type":"ContainerStarted","Data":"9d3515cc70cfea80497d7dbb6ae7a98efb0e1c7efb31358a8be157ca219d08ff"} Jul 09 22:45:03.298341 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:03.298307 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" event={"ID":"95056ed2-d4bc-43e8-a5c5-5a06ea781e6b","Type":"ContainerStarted","Data":"228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b"} Jul 09 22:45:03.316876 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:45:03.316818 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" podStartSLOduration=1.178854745 podStartE2EDuration="3.316802127s" totalImagesPullingTime="2.137947382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:03.314693989 +0000 UTC m=+1018.612121288" watchObservedRunningTime="2026-07-09 22:45:03.316802127 +0000 UTC m=+1018.614229424" Jul 09 22:46:00.011044 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:00.010963 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb"] Jul 09 22:46:00.011548 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:00.011194 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" podUID="95056ed2-d4bc-43e8-a5c5-5a06ea781e6b" containerName="cleanup" containerID="cri-o://228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b" gracePeriod=30 Jul 09 22:46:14.271839 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:14.271802 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:46:28.967099 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:28.967065 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:46:30.210859 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.210835 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" Jul 09 22:46:30.277012 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.276926 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zh6q\" (UniqueName: \"kubernetes.io/projected/95056ed2-d4bc-43e8-a5c5-5a06ea781e6b-kube-api-access-9zh6q\") pod \"95056ed2-d4bc-43e8-a5c5-5a06ea781e6b\" (UID: \"95056ed2-d4bc-43e8-a5c5-5a06ea781e6b\") " Jul 09 22:46:30.279119 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.279089 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95056ed2-d4bc-43e8-a5c5-5a06ea781e6b-kube-api-access-9zh6q" (OuterVolumeSpecName: "kube-api-access-9zh6q") pod "95056ed2-d4bc-43e8-a5c5-5a06ea781e6b" (UID: "95056ed2-d4bc-43e8-a5c5-5a06ea781e6b"). InnerVolumeSpecName "kube-api-access-9zh6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:46:30.377648 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.377596 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zh6q\" (UniqueName: \"kubernetes.io/projected/95056ed2-d4bc-43e8-a5c5-5a06ea781e6b-kube-api-access-9zh6q\") on node \"ip-10-0-136-228.ec2.internal\" DevicePath \"\"" Jul 09 22:46:30.761669 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.761635 2567 generic.go:356] "Generic (PLEG): container finished" podID="95056ed2-d4bc-43e8-a5c5-5a06ea781e6b" containerID="228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b" exitCode=137 Jul 09 22:46:30.761884 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.761682 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" Jul 09 22:46:30.761884 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.761717 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" event={"ID":"95056ed2-d4bc-43e8-a5c5-5a06ea781e6b","Type":"ContainerDied","Data":"228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b"} Jul 09 22:46:30.761884 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.761779 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb" event={"ID":"95056ed2-d4bc-43e8-a5c5-5a06ea781e6b","Type":"ContainerDied","Data":"9d3515cc70cfea80497d7dbb6ae7a98efb0e1c7efb31358a8be157ca219d08ff"} Jul 09 22:46:30.761884 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.761810 2567 scope.go:117] "RemoveContainer" containerID="228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b" Jul 09 22:46:30.774281 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.774253 2567 scope.go:117] "RemoveContainer" containerID="228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b" Jul 09 22:46:30.774610 ip-10-0-136-228 kubenswrapper[2567]: E0709 22:46:30.774590 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b\": container with ID starting with 228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b not found: ID does not exist" containerID="228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b" Jul 09 22:46:30.774652 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.774619 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b"} err="failed to get container status \"228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b\": rpc error: code = NotFound desc = could not find container \"228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b\": container with ID starting with 228bb5eebf62baca602097cb472f4f5cd71c0638d034acb34b137424b98fc67b not found: ID does not exist" Jul 09 22:46:30.792176 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.792143 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb"] Jul 09 22:46:30.796465 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:30.796438 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727285-rp4wb"] Jul 09 22:46:31.178600 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:46:31.178567 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95056ed2-d4bc-43e8-a5c5-5a06ea781e6b" path="/var/lib/kubelet/pods/95056ed2-d4bc-43e8-a5c5-5a06ea781e6b/volumes" Jul 09 22:47:12.271997 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:47:12.271958 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:47:31.869592 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:47:31.869503 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:48:15.676754 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:48:15.676718 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:49:12.877146 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:49:12.877103 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:51:28.806654 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:51:28.806622 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:51:45.274223 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:51:45.274183 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lcslq"] Jul 09 22:52:28.668681 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:28.668644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6cbzk_a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3/manager/0.log" Jul 09 22:52:29.284836 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:29.284809 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ddf58f47c-2lzcq_164a1216-4204-46f1-a4d1-8f4d4528fe5b/copy-manifests/0.log" Jul 09 22:52:29.296458 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:29.296420 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ddf58f47c-2lzcq_164a1216-4204-46f1-a4d1-8f4d4528fe5b/manager/0.log" Jul 09 22:52:31.734997 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:31.734963 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xd878_10bf1d7a-515b-4179-ab64-394b831f5850/registry-server/0.log" Jul 09 22:52:31.856779 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:31.856751 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lk9b8_3f9890f5-6315-4ef4-ab1a-637433718f35/manager/0.log" Jul 09 22:52:31.977069 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:31.977042 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lcslq_f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d/limitador/0.log" Jul 09 22:52:32.088338 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:32.088310 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bgddh_8d3f566e-4754-4a3d-9ce1-ea3939b1b01c/manager/0.log" Jul 09 22:52:32.445850 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:32.445763 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4pxmpx_482367bb-ef9c-42ee-bd36-8f9ffcfcb23f/istio-proxy/0.log" Jul 09 22:52:32.896820 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:32.896790 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9649k_5c3ad29f-2d96-4854-adf5-f5efe874bc4e/istio-proxy/1.log" Jul 09 22:52:37.749978 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.749943 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s5jvk/must-gather-kzzqr"] Jul 09 22:52:37.750391 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.750377 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95056ed2-d4bc-43e8-a5c5-5a06ea781e6b" containerName="cleanup" Jul 09 22:52:37.750391 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.750392 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="95056ed2-d4bc-43e8-a5c5-5a06ea781e6b" containerName="cleanup" Jul 09 22:52:37.750473 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.750463 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="95056ed2-d4bc-43e8-a5c5-5a06ea781e6b" containerName="cleanup" Jul 09 22:52:37.753769 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.753747 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5jvk/must-gather-kzzqr" Jul 09 22:52:37.756389 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.756368 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s5jvk\"/\"default-dockercfg-tdkvb\"" Jul 09 22:52:37.757239 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.757214 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5jvk\"/\"kube-root-ca.crt\"" Jul 09 22:52:37.757346 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.757295 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5jvk\"/\"openshift-service-ca.crt\"" Jul 09 22:52:37.774658 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.774634 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5jvk/must-gather-kzzqr"] Jul 09 22:52:37.908033 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.907984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/43fc4a6d-4689-4955-8223-879122d629cd-must-gather-output\") pod \"must-gather-kzzqr\" (UID: \"43fc4a6d-4689-4955-8223-879122d629cd\") " pod="openshift-must-gather-s5jvk/must-gather-kzzqr" Jul 09 22:52:37.908234 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:37.908078 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qppq6\" (UniqueName: \"kubernetes.io/projected/43fc4a6d-4689-4955-8223-879122d629cd-kube-api-access-qppq6\") pod \"must-gather-kzzqr\" (UID: \"43fc4a6d-4689-4955-8223-879122d629cd\") " pod="openshift-must-gather-s5jvk/must-gather-kzzqr" Jul 09 22:52:38.008707 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:38.008615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/43fc4a6d-4689-4955-8223-879122d629cd-must-gather-output\") pod \"must-gather-kzzqr\" (UID: \"43fc4a6d-4689-4955-8223-879122d629cd\") " pod="openshift-must-gather-s5jvk/must-gather-kzzqr" Jul 09 22:52:38.008707 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:38.008694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qppq6\" (UniqueName: \"kubernetes.io/projected/43fc4a6d-4689-4955-8223-879122d629cd-kube-api-access-qppq6\") pod \"must-gather-kzzqr\" (UID: \"43fc4a6d-4689-4955-8223-879122d629cd\") " pod="openshift-must-gather-s5jvk/must-gather-kzzqr" Jul 09 22:52:38.009060 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:38.009042 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/43fc4a6d-4689-4955-8223-879122d629cd-must-gather-output\") pod \"must-gather-kzzqr\" (UID: \"43fc4a6d-4689-4955-8223-879122d629cd\") " pod="openshift-must-gather-s5jvk/must-gather-kzzqr" Jul 09 22:52:38.016806 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:38.016770 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qppq6\" (UniqueName: \"kubernetes.io/projected/43fc4a6d-4689-4955-8223-879122d629cd-kube-api-access-qppq6\") pod \"must-gather-kzzqr\" (UID: \"43fc4a6d-4689-4955-8223-879122d629cd\") " pod="openshift-must-gather-s5jvk/must-gather-kzzqr" Jul 09 22:52:38.063524 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:38.063494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5jvk/must-gather-kzzqr" Jul 09 22:52:38.199129 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:38.199094 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5jvk/must-gather-kzzqr"] Jul 09 22:52:38.201653 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:52:38.201625 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43fc4a6d_4689_4955_8223_879122d629cd.slice/crio-1102af7c11969a3058783b909c5bbfdfd853dfb4466c1de31de2f737b402f7c6 WatchSource:0}: Error finding container 1102af7c11969a3058783b909c5bbfdfd853dfb4466c1de31de2f737b402f7c6: Status 404 returned error can't find the container with id 1102af7c11969a3058783b909c5bbfdfd853dfb4466c1de31de2f737b402f7c6 Jul 09 22:52:38.203569 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:38.203556 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 22:52:38.608896 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:38.608865 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5jvk/must-gather-kzzqr" event={"ID":"43fc4a6d-4689-4955-8223-879122d629cd","Type":"ContainerStarted","Data":"1102af7c11969a3058783b909c5bbfdfd853dfb4466c1de31de2f737b402f7c6"} Jul 09 22:52:39.617794 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:39.617733 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5jvk/must-gather-kzzqr" event={"ID":"43fc4a6d-4689-4955-8223-879122d629cd","Type":"ContainerStarted","Data":"8ec89279c5a1772917e9187312672757311c44968cd14e2702939396ce20f4b3"} Jul 09 22:52:39.617794 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:39.617784 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5jvk/must-gather-kzzqr" event={"ID":"43fc4a6d-4689-4955-8223-879122d629cd","Type":"ContainerStarted","Data":"c96f8e1b2305a2412bfebd50690fdfa06abc351a2709f3d0623fcd0dd207f426"} Jul 09 22:52:39.634363 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:39.634151 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s5jvk/must-gather-kzzqr" podStartSLOduration=1.970120803 podStartE2EDuration="2.634127096s" totalImagesPullingTime="664.006293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:52:39.633423179 +0000 UTC m=+1474.930850479" watchObservedRunningTime="2026-07-09 22:52:39.634127096 +0000 UTC m=+1474.931554395" Jul 09 22:52:40.504858 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:40.504816 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nwnhp_e80bba4c-ad62-4e7b-887f-bcfa4dcee8bb/global-pull-secret-syncer/0.log" Jul 09 22:52:40.589668 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:40.589622 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mr5vv_0eaea9d0-860a-407a-8473-b2fe449e6220/konnectivity-agent/0.log" Jul 09 22:52:40.664061 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:40.664031 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-228.ec2.internal_9bb0dda8697e373c519f6dc1fe8e110b/haproxy/0.log" Jul 09 22:52:46.134130 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:46.134091 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xd878_10bf1d7a-515b-4179-ab64-394b831f5850/registry-server/0.log" Jul 09 22:52:46.208935 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:46.208548 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lk9b8_3f9890f5-6315-4ef4-ab1a-637433718f35/manager/0.log" Jul 09 22:52:46.243934 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:46.243674 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lcslq_f5623cb1-81f7-4dfa-9632-b9d1bdd8f67d/limitador/0.log" Jul 09 22:52:46.285710 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:46.285683 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bgddh_8d3f566e-4754-4a3d-9ce1-ea3939b1b01c/manager/0.log" Jul 09 22:52:47.916450 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:47.916367 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e0df2c47-8cc1-450b-a678-795671664f32/alertmanager/0.log" Jul 09 22:52:47.946054 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:47.945986 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e0df2c47-8cc1-450b-a678-795671664f32/config-reloader/0.log" Jul 09 22:52:47.965418 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:47.965387 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e0df2c47-8cc1-450b-a678-795671664f32/kube-rbac-proxy-web/0.log" Jul 09 22:52:47.986212 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:47.986176 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e0df2c47-8cc1-450b-a678-795671664f32/kube-rbac-proxy/0.log" Jul 09 22:52:48.011445 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.011414 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e0df2c47-8cc1-450b-a678-795671664f32/kube-rbac-proxy-metric/0.log" Jul 09 22:52:48.037937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.037241 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e0df2c47-8cc1-450b-a678-795671664f32/prom-label-proxy/0.log" Jul 09 22:52:48.063468 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.063436 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e0df2c47-8cc1-450b-a678-795671664f32/init-config-reloader/0.log" Jul 09 22:52:48.147365 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.147336 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xk96q_cacccc19-140b-458a-933e-329eb96fe902/kube-state-metrics/0.log" Jul 09 22:52:48.164124 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.164096 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xk96q_cacccc19-140b-458a-933e-329eb96fe902/kube-rbac-proxy-main/0.log" Jul 09 22:52:48.191625 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.191533 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xk96q_cacccc19-140b-458a-933e-329eb96fe902/kube-rbac-proxy-self/0.log" Jul 09 22:52:48.236871 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.236817 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7655556945-vsksz_7a7f5334-a858-46e7-bc8c-c1d2a29d7180/metrics-server/0.log" Jul 09 22:52:48.270436 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.270405 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-qdvl4_c338ceda-f46c-40b6-95d9-ae6a06db0e66/monitoring-plugin/0.log" Jul 09 22:52:48.371458 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.371431 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9jqr_c5cef037-6b09-431d-8fca-f5e55ead2078/node-exporter/0.log" Jul 09 22:52:48.396441 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.396407 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9jqr_c5cef037-6b09-431d-8fca-f5e55ead2078/kube-rbac-proxy/0.log" Jul 09 22:52:48.418405 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.418374 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9jqr_c5cef037-6b09-431d-8fca-f5e55ead2078/init-textfile/0.log" Jul 09 22:52:48.537540 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.537514 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-vdhx2_36cc8503-5e66-4696-bab6-279da732d141/kube-rbac-proxy-main/0.log" Jul 09 22:52:48.559967 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.559937 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-vdhx2_36cc8503-5e66-4696-bab6-279da732d141/kube-rbac-proxy-self/0.log" Jul 09 22:52:48.582862 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.582831 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-vdhx2_36cc8503-5e66-4696-bab6-279da732d141/openshift-state-metrics/0.log" Jul 09 22:52:48.621871 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.620847 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22cc17a9-ca0f-49fa-b8b7-850a2c89fa40/prometheus/0.log" Jul 09 22:52:48.647170 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.647139 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22cc17a9-ca0f-49fa-b8b7-850a2c89fa40/config-reloader/0.log" Jul 09 22:52:48.669897 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.669859 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22cc17a9-ca0f-49fa-b8b7-850a2c89fa40/thanos-sidecar/0.log" Jul 09 22:52:48.699324 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.699292 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22cc17a9-ca0f-49fa-b8b7-850a2c89fa40/kube-rbac-proxy-web/0.log" Jul 09 22:52:48.721649 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.721613 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22cc17a9-ca0f-49fa-b8b7-850a2c89fa40/kube-rbac-proxy/0.log" Jul 09 22:52:48.748295 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.748268 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22cc17a9-ca0f-49fa-b8b7-850a2c89fa40/kube-rbac-proxy-thanos/0.log" Jul 09 22:52:48.775414 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.775391 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22cc17a9-ca0f-49fa-b8b7-850a2c89fa40/init-config-reloader/0.log" Jul 09 22:52:48.804812 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.804728 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-z8bfs_fccca4d4-a8fc-4bd6-9071-6ec26bbfc738/prometheus-operator/0.log" Jul 09 22:52:48.825649 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.825619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-z8bfs_fccca4d4-a8fc-4bd6-9071-6ec26bbfc738/kube-rbac-proxy/0.log" Jul 09 22:52:48.854057 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.854028 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-vpn8b_7949bf2f-b86c-491f-bb20-7583a7a2ca23/prometheus-operator-admission-webhook/0.log" Jul 09 22:52:48.890413 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.890385 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74c9d84899-xzvlk_cafe90cc-1b15-40e4-91c8-3e099f4bd466/telemeter-client/0.log" Jul 09 22:52:48.914646 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.914623 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74c9d84899-xzvlk_cafe90cc-1b15-40e4-91c8-3e099f4bd466/reload/0.log" Jul 09 22:52:48.935252 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.935221 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74c9d84899-xzvlk_cafe90cc-1b15-40e4-91c8-3e099f4bd466/kube-rbac-proxy/0.log" Jul 09 22:52:48.968384 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.968356 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f56fcd9d9-22gsp_358aeabd-5de9-4726-b326-a0ff5b5f2374/thanos-query/0.log" Jul 09 22:52:48.988587 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:48.988554 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f56fcd9d9-22gsp_358aeabd-5de9-4726-b326-a0ff5b5f2374/kube-rbac-proxy-web/0.log" Jul 09 22:52:49.009386 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:49.009352 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f56fcd9d9-22gsp_358aeabd-5de9-4726-b326-a0ff5b5f2374/kube-rbac-proxy/0.log" Jul 09 22:52:49.029606 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:49.029579 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f56fcd9d9-22gsp_358aeabd-5de9-4726-b326-a0ff5b5f2374/prom-label-proxy/0.log" Jul 09 22:52:49.054081 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:49.054045 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f56fcd9d9-22gsp_358aeabd-5de9-4726-b326-a0ff5b5f2374/kube-rbac-proxy-rules/0.log" Jul 09 22:52:49.078275 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:49.078196 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f56fcd9d9-22gsp_358aeabd-5de9-4726-b326-a0ff5b5f2374/kube-rbac-proxy-metrics/0.log" Jul 09 22:52:50.746310 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.746257 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6"] Jul 09 22:52:50.752937 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.752889 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.758889 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.758854 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6"] Jul 09 22:52:50.847835 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.847780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-proc\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.848058 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.847848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-podres\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.848058 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.847893 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-lib-modules\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.848058 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.847941 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-sys\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.848058 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.848008 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8p2l\" (UniqueName: \"kubernetes.io/projected/00926f86-9ede-454c-be2e-4f4dbb780824-kube-api-access-x8p2l\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.949080 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.949027 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-proc\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.949279 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.949106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-podres\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.949279 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.949163 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-lib-modules\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.949279 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.949201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-sys\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.949472 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.949281 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8p2l\" (UniqueName: \"kubernetes.io/projected/00926f86-9ede-454c-be2e-4f4dbb780824-kube-api-access-x8p2l\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.949700 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.949678 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-podres\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.949900 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.949782 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-lib-modules\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.950063 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.949826 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-sys\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.950162 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.949844 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00926f86-9ede-454c-be2e-4f4dbb780824-proc\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:50.957896 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:50.957868 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8p2l\" (UniqueName: \"kubernetes.io/projected/00926f86-9ede-454c-be2e-4f4dbb780824-kube-api-access-x8p2l\") pod \"perf-node-gather-daemonset-7xgc6\" (UID: \"00926f86-9ede-454c-be2e-4f4dbb780824\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:51.068287 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:51.068249 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:51.260332 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:51.259346 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6"] Jul 09 22:52:51.262657 ip-10-0-136-228 kubenswrapper[2567]: W0709 22:52:51.262605 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod00926f86_9ede_454c_be2e_4f4dbb780824.slice/crio-fb4312cf45e5ea035eaf24be4b901a4b40621c79a6431ffe9a72e013c3c66d70 WatchSource:0}: Error finding container fb4312cf45e5ea035eaf24be4b901a4b40621c79a6431ffe9a72e013c3c66d70: Status 404 returned error can't find the container with id fb4312cf45e5ea035eaf24be4b901a4b40621c79a6431ffe9a72e013c3c66d70 Jul 09 22:52:51.440888 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:51.440823 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64967b6b88-2cp4q_cd697767-bf26-4e9a-a3f4-3aa3858cf614/console/0.log" Jul 09 22:52:51.709442 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:51.709348 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" event={"ID":"00926f86-9ede-454c-be2e-4f4dbb780824","Type":"ContainerStarted","Data":"a2f75290fd912a0d1607371ffe338e4c9709942d95a39f2b12e6640f31a794b4"} Jul 09 22:52:51.709442 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:51.709405 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" event={"ID":"00926f86-9ede-454c-be2e-4f4dbb780824","Type":"ContainerStarted","Data":"fb4312cf45e5ea035eaf24be4b901a4b40621c79a6431ffe9a72e013c3c66d70"} Jul 09 22:52:51.709690 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:51.709542 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:51.726099 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:51.726043 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" podStartSLOduration=1.726023343 podStartE2EDuration="1.726023343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:52:51.725709456 +0000 UTC m=+1487.023136754" watchObservedRunningTime="2026-07-09 22:52:51.726023343 +0000 UTC m=+1487.023450643" Jul 09 22:52:53.196979 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:53.196951 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r9mt2_5673949e-086e-4f45-95ff-adb59fca9c76/dns/0.log" Jul 09 22:52:53.221081 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:53.221048 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r9mt2_5673949e-086e-4f45-95ff-adb59fca9c76/kube-rbac-proxy/0.log" Jul 09 22:52:53.327149 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:53.327118 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4v6h_b335c969-1a70-466e-81a1-20a6309c2545/dns-node-resolver/0.log" Jul 09 22:52:53.921926 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:53.921897 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ns2b8_ccdeccaf-ff58-483f-b19f-a647c6d0af7f/node-ca/0.log" Jul 09 22:52:54.898442 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:54.898402 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4pxmpx_482367bb-ef9c-42ee-bd36-8f9ffcfcb23f/istio-proxy/0.log" Jul 09 22:52:55.036665 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:55.036629 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9649k_5c3ad29f-2d96-4854-adf5-f5efe874bc4e/istio-proxy/0.log" Jul 09 22:52:55.056294 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:55.056261 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9649k_5c3ad29f-2d96-4854-adf5-f5efe874bc4e/istio-proxy/1.log" Jul 09 22:52:55.779955 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:55.779890 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6cptd_a265bf2b-d69e-46d4-87fe-b921739f3d25/serve-healthcheck-canary/0.log" Jul 09 22:52:56.308275 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:56.308244 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2rf4j_3eb01622-2a1a-4610-9acd-6164cf45019f/kube-rbac-proxy/0.log" Jul 09 22:52:56.332032 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:56.332004 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2rf4j_3eb01622-2a1a-4610-9acd-6164cf45019f/exporter/0.log" Jul 09 22:52:56.359302 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:56.359266 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2rf4j_3eb01622-2a1a-4610-9acd-6164cf45019f/extractor/0.log" Jul 09 22:52:57.727534 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:57.727503 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-7xgc6" Jul 09 22:52:58.743894 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:58.743865 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6cbzk_a0ed3c5b-feb1-490e-9a85-c0671cf7d9b3/manager/0.log" Jul 09 22:52:58.957414 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:58.957384 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ddf58f47c-2lzcq_164a1216-4204-46f1-a4d1-8f4d4528fe5b/manager/0.log" Jul 09 22:52:58.974981 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:52:58.974950 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ddf58f47c-2lzcq_164a1216-4204-46f1-a4d1-8f4d4528fe5b/copy-manifests/0.log" Jul 09 22:53:00.256933 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:00.256883 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75dd6b9c58-2mpnd_625ef294-3b1a-4cae-8cb0-af4d6230607f/manager/0.log" Jul 09 22:53:00.311494 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:00.311461 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hcps9_4789afc8-54d6-4fcb-89b2-4c2e1c54c6ef/openshift-lws-operator/0.log" Jul 09 22:53:01.403549 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:01.403520 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4pxmpx_482367bb-ef9c-42ee-bd36-8f9ffcfcb23f/istio-proxy/0.log" Jul 09 22:53:01.513307 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:01.513279 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9649k_5c3ad29f-2d96-4854-adf5-f5efe874bc4e/istio-proxy/0.log" Jul 09 22:53:01.537037 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:01.537007 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9649k_5c3ad29f-2d96-4854-adf5-f5efe874bc4e/istio-proxy/1.log" Jul 09 22:53:02.781153 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:02.781104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4pxmpx_482367bb-ef9c-42ee-bd36-8f9ffcfcb23f/istio-proxy/0.log" Jul 09 22:53:02.882874 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:02.882843 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9649k_5c3ad29f-2d96-4854-adf5-f5efe874bc4e/istio-proxy/0.log" Jul 09 22:53:02.900560 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:02.900526 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9649k_5c3ad29f-2d96-4854-adf5-f5efe874bc4e/istio-proxy/1.log" Jul 09 22:53:07.261824 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.261790 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jzpnc_a1ba1da8-17c5-44da-96e5-dcead667aa5f/kube-multus-additional-cni-plugins/0.log" Jul 09 22:53:07.283015 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.282981 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jzpnc_a1ba1da8-17c5-44da-96e5-dcead667aa5f/egress-router-binary-copy/0.log" Jul 09 22:53:07.305834 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.305803 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jzpnc_a1ba1da8-17c5-44da-96e5-dcead667aa5f/cni-plugins/0.log" Jul 09 22:53:07.329223 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.329187 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jzpnc_a1ba1da8-17c5-44da-96e5-dcead667aa5f/bond-cni-plugin/0.log" Jul 09 22:53:07.351531 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.351505 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jzpnc_a1ba1da8-17c5-44da-96e5-dcead667aa5f/routeoverride-cni/0.log" Jul 09 22:53:07.376956 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.376902 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jzpnc_a1ba1da8-17c5-44da-96e5-dcead667aa5f/whereabouts-cni-bincopy/0.log" Jul 09 22:53:07.399340 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.399312 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jzpnc_a1ba1da8-17c5-44da-96e5-dcead667aa5f/whereabouts-cni/0.log" Jul 09 22:53:07.466644 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.466619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pnfbh_1b67bf4b-07c2-42b6-b12b-7b53148f3f43/kube-multus/0.log" Jul 09 22:53:07.581362 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.581333 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l6ts2_15eee511-4e3b-4641-971b-de9c85afef15/network-metrics-daemon/0.log" Jul 09 22:53:07.600732 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:07.600701 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l6ts2_15eee511-4e3b-4641-971b-de9c85afef15/kube-rbac-proxy/0.log" Jul 09 22:53:08.437503 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:08.437468 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2x4dh_02615a1f-2d64-4642-9b64-a6c2347cc52f/ovn-controller/0.log" Jul 09 22:53:08.453668 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:08.453640 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2x4dh_02615a1f-2d64-4642-9b64-a6c2347cc52f/ovn-acl-logging/0.log" Jul 09 22:53:08.474023 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:08.473997 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2x4dh_02615a1f-2d64-4642-9b64-a6c2347cc52f/kube-rbac-proxy-node/0.log" Jul 09 22:53:08.502027 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:08.501997 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2x4dh_02615a1f-2d64-4642-9b64-a6c2347cc52f/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 22:53:08.529503 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:08.529467 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2x4dh_02615a1f-2d64-4642-9b64-a6c2347cc52f/northd/0.log" Jul 09 22:53:08.550644 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:08.550619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2x4dh_02615a1f-2d64-4642-9b64-a6c2347cc52f/nbdb/0.log" Jul 09 22:53:08.570097 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:08.570064 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2x4dh_02615a1f-2d64-4642-9b64-a6c2347cc52f/sbdb/0.log" Jul 09 22:53:08.616065 ip-10-0-136-228 kubenswrapper[2567]: I0709 22:53:08.616027 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2x4dh_02615a1f-2d64-4642-9b64-a6c2347cc52f/ovnkube-controller/0.log"