Jul 24 09:56:45.460549 ip-10-0-131-23 systemd[1]: Starting Kubernetes Kubelet... Jul 24 09:56:45.911092 ip-10-0-131-23 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 09:56:45.911092 ip-10-0-131-23 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 09:56:45.911092 ip-10-0-131-23 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 09:56:45.911092 ip-10-0-131-23 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 09:56:45.911092 ip-10-0-131-23 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 09:56:45.913170 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.913040 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 09:56:45.918113 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918092 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:56:45.918113 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918113 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918117 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918120 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918123 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918125 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918128 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918131 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918134 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918136 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918139 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918141 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918144 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918148 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918150 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918153 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918156 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918158 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918161 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918164 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:56:45.918187 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918183 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918187 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918190 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918192 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918196 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918198 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918201 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918205 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918208 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918210 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918213 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918216 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918218 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918221 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918223 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918240 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918243 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918245 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918249 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918252 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:56:45.918667 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918254 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918257 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918259 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918262 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918264 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918267 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918269 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918272 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918274 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918277 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918281 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918283 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918286 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918288 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918292 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918295 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918297 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918299 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918303 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918306 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:56:45.919133 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918308 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918311 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918315 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918319 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918322 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918325 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918328 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918331 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918335 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918338 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918340 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918343 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918346 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918349 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918351 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918354 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918356 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918359 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918361 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918364 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:56:45.919644 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918366 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918369 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918371 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918374 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918377 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918381 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918385 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918388 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918390 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918394 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918396 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918398 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918403 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918406 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918409 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918411 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918414 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918417 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:56:45.920130 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.918419 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:56:45.921016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921002 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:56:45.921016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921015 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921018 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921022 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921025 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921030 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921034 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921036 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921039 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921041 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921044 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921047 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921049 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921051 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921054 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921057 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921059 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921063 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921065 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921068 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921070 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:56:45.921099 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921073 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921075 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921078 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921080 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921083 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921085 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921088 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921090 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921093 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921096 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921099 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921102 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921104 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921107 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921110 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921113 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921116 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921119 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921121 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921124 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:56:45.921609 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921127 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921129 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921132 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921134 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921137 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921139 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921143 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921147 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921149 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921152 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921154 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921157 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921160 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921162 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921166 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921169 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921171 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921174 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921177 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:56:45.922104 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921179 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921183 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921187 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921191 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921195 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921199 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921202 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921204 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921208 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921210 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921213 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921216 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921219 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921221 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921224 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921241 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921244 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921247 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:56:45.922582 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921249 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921252 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921254 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921257 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921259 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921262 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921265 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921267 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921270 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921274 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921276 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921279 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921282 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921284 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921287 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921290 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921292 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921295 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921297 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921300 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:56:45.923016 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921302 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921716 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921722 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921725 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921728 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921732 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921735 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921737 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921740 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921743 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921746 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921748 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921751 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921754 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921757 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921759 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921761 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921764 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921767 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921769 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:56:45.923509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921772 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921776 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921779 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921781 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921784 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921786 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921788 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921791 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921793 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921796 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921799 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921801 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921803 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921806 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921809 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921811 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921813 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921816 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921818 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921821 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:56:45.924003 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921824 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921826 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921828 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921831 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921833 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921836 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921839 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921842 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921845 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921847 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921850 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921852 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921854 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921857 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921860 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921863 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921866 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921868 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921872 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921874 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:56:45.924503 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921877 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921880 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921882 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921884 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921887 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921889 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921892 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921894 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921896 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921899 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921901 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921904 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921907 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921909 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921911 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921914 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921917 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921921 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921924 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:56:45.924992 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921926 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921930 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921933 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921936 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921939 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921942 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921945 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921948 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921951 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921953 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921956 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921958 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921961 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921963 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921966 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921968 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921971 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921973 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921975 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:56:45.925457 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921978 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.921980 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922051 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922059 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922066 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922070 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922074 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922078 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922082 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922092 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922095 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922098 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922102 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922105 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922109 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922112 2563 flags.go:64] FLAG: --cgroup-root="" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922115 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922118 2563 flags.go:64] FLAG: --client-ca-file="" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922121 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922124 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922128 2563 flags.go:64] FLAG: --cluster-domain="" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922131 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922134 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922137 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 09:56:45.925904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922140 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922144 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922147 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922150 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922153 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922156 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922159 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922162 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922165 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922168 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922173 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922176 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922179 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922181 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922184 2563 flags.go:64] FLAG: --enable-server="true" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922188 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922192 2563 flags.go:64] FLAG: --event-burst="100" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922195 2563 flags.go:64] FLAG: --event-qps="50" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922198 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922201 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922204 2563 flags.go:64] FLAG: --eviction-hard="" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922208 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922211 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922214 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922217 2563 flags.go:64] FLAG: --eviction-soft="" Jul 24 09:56:45.926490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922219 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922223 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922244 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922247 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922250 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922253 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922256 2563 flags.go:64] FLAG: --feature-gates="" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922260 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922263 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922266 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922269 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922272 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922275 2563 flags.go:64] FLAG: --help="false" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922278 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-131-23.ec2.internal" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922281 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922284 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922287 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922290 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922294 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922297 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922299 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922302 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922305 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 09:56:45.927074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922308 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922311 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922314 2563 flags.go:64] FLAG: --kube-reserved="" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922317 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922320 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922323 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922326 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922328 2563 flags.go:64] FLAG: --lock-file="" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922331 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922334 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922337 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922344 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922347 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922350 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922352 2563 flags.go:64] FLAG: --logging-format="text" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922355 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922358 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922361 2563 flags.go:64] FLAG: --manifest-url="" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922364 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922369 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922371 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922375 2563 flags.go:64] FLAG: --max-pods="110" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922378 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922381 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922384 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 09:56:45.927664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922387 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922390 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922393 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922396 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922403 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922406 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922409 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922412 2563 flags.go:64] FLAG: --pod-cidr="" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922415 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922422 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922425 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922428 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922431 2563 flags.go:64] FLAG: --port="10250" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922434 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922437 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09feedc9c51efc009" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922440 2563 flags.go:64] FLAG: --qos-reserved="" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922443 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922446 2563 flags.go:64] FLAG: --register-node="true" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922449 2563 flags.go:64] FLAG: --register-with-taints="" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922456 2563 flags.go:64] FLAG: --registry-burst="10" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922459 2563 flags.go:64] FLAG: --registry-qps="5" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922461 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922464 2563 flags.go:64] FLAG: --reserved-memory="" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922468 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922472 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 09:56:45.928287 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922475 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922478 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922480 2563 flags.go:64] FLAG: --runonce="false" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922483 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922486 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922489 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922492 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922495 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922498 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922501 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922504 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922506 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922509 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922512 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922515 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922518 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922521 2563 flags.go:64] FLAG: --system-cgroups="" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922524 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922529 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922532 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922535 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922539 2563 flags.go:64] FLAG: --tls-min-version="" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922542 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922545 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922548 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 09:56:45.928889 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922551 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922554 2563 flags.go:64] FLAG: --v="2" Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922558 2563 flags.go:64] FLAG: --version="false" Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922562 2563 flags.go:64] FLAG: --vmodule="" Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922566 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.922569 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922686 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922690 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922693 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922696 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922698 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922701 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922703 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922706 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922708 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922711 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922713 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922715 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922718 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922720 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922723 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:56:45.929687 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922726 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922728 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922731 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922734 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922736 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922739 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922741 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922743 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922746 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922749 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922754 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922756 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922761 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922765 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922768 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922772 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922775 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922778 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922782 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:56:45.930191 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922785 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922788 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922791 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922794 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922797 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922799 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922802 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922804 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922807 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922809 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922812 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922814 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922817 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922819 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922822 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922824 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922827 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922830 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922833 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922836 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:56:45.930686 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922838 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922841 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922843 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922847 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922850 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922854 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922857 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922859 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922861 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922864 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922866 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922869 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922871 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922874 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922876 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922879 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922881 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922884 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922886 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:56:45.931188 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922888 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922891 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922894 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922896 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922898 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922901 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922903 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922905 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922908 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922911 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922913 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922916 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922919 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922921 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922924 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922926 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922929 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922932 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922936 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922939 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:56:45.931684 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922941 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922944 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922948 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922951 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922954 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.922957 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.923850 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.931092 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.931109 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.931129 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.931135 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931193 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931199 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931202 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:56:45.932181 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931205 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931208 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931211 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931214 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931216 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931219 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931223 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931246 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931250 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931260 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931263 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931266 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931268 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931271 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931274 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931277 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931279 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931282 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931285 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931288 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:56:45.932589 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931290 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931293 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931296 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931298 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931301 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931304 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931307 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931310 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931312 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931315 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931317 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931320 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931322 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931325 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931327 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931330 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931332 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931334 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931337 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:56:45.933061 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931339 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931342 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931345 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931347 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931350 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931353 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931355 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931358 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931360 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931362 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931365 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931369 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931373 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931375 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931378 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931381 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931384 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931387 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931390 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:56:45.933537 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931392 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931395 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931398 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931401 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931403 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931405 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931408 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931410 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931413 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931415 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931418 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931420 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931422 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931425 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931428 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931430 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931432 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931435 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931438 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931441 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:56:45.934007 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931444 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931448 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931451 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931454 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931456 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931459 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931461 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931463 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931466 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931469 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931471 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931474 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931476 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931479 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931481 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931484 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931486 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:56:45.934533 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931489 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.931494 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931614 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931618 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931621 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931624 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931627 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931629 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931632 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931634 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931637 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931639 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931642 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931645 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:56:45.934938 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931647 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931650 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931652 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931655 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931658 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931660 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931663 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931666 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931668 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931671 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931673 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931677 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931681 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931684 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931687 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931690 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931702 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931705 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931708 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:56:45.935301 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931710 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931713 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931715 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931718 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931720 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931723 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931725 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931727 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931730 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931732 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931735 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931737 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931740 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931743 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931746 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931748 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931750 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931753 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931755 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931758 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:56:45.935835 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931761 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931763 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931766 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931768 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931770 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931773 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931776 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931778 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931781 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931783 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931786 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931788 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931791 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931793 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931796 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931798 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931801 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931803 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931805 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931808 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:56:45.936344 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931810 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931813 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931815 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931818 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931820 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931823 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931826 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931828 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931831 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931833 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931835 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931839 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931843 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931846 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931849 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931852 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931856 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931859 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931861 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:56:45.936813 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931864 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931866 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931869 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931871 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931874 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931876 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931878 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931881 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:45.931883 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.931888 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.932006 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.934518 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.936192 2563 server.go:1019] "Starting client certificate rotation" Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.936299 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 09:56:45.937309 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.936340 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 09:56:45.940399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.940373 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 09:56:45.944192 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.944170 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 09:56:45.951288 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.951265 2563 log.go:25] "Validated CRI v1 runtime API" Jul 24 09:56:45.953783 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.953760 2563 log.go:25] "Validated CRI v1 image API" Jul 24 09:56:45.955568 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.955545 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 09:56:45.959027 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.959003 2563 fs.go:135] Filesystem UUIDs: map[1c7e0036-9747-45f5-a735-72de872d81d9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a027ba47-72fc-48fb-9860-0ec778a43027:/dev/nvme0n1p4] Jul 24 09:56:45.959101 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.959027 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 09:56:45.966111 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.965974 2563 manager.go:216] Machine: {Timestamp:2026-07-24 09:56:45.96347013 +0000 UTC m=+0.372957198 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094103 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28e9e747db51d08048e1ac24c44f27 SystemUUID:ec28e9e7-47db-51d0-8048-e1ac24c44f27 BootID:15f4298b-03ee-4fd4-91be-54775b0886e3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:65:92:4c:2e:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:65:92:4c:2e:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:45:84:1d:3e:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 09:56:45.966111 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.966098 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 09:56:45.966274 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.966199 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 09:56:45.970285 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.970249 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 09:56:45.970433 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.970285 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 09:56:45.971152 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.971142 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 09:56:45.971191 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.971154 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 09:56:45.971191 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.971162 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 09:56:45.971518 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.971502 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 09:56:45.971886 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.971874 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 09:56:45.973147 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.973137 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 09:56:45.976115 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.976101 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 24 09:56:45.976271 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.976260 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 09:56:45.976323 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.976290 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 24 09:56:45.976323 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.976301 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 09:56:45.976323 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.976316 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 09:56:45.976426 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.976329 2563 kubelet.go:398] "Adding apiserver pod source" Jul 24 09:56:45.976426 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.976339 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 09:56:45.976748 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.976734 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 09:56:45.976794 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.976757 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 09:56:45.979166 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.979143 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 09:56:45.981684 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.981668 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 09:56:45.981769 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.981708 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 09:56:45.983817 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.983805 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 09:56:45.983896 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.983826 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 09:56:45.983896 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.983836 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 09:56:45.983896 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.983845 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 09:56:45.983896 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.983859 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 09:56:45.984053 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.983867 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 09:56:45.984204 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.984187 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 09:56:45.984351 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.984334 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 09:56:45.984432 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.984356 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 09:56:45.984432 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.984368 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 09:56:45.984432 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.984382 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 09:56:45.984432 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.984392 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 09:56:45.985314 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.985292 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 09:56:45.985314 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.985315 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 09:56:45.987258 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:45.987210 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 09:56:45.987403 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:45.987381 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 09:56:45.988783 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.988769 2563 server.go:1268] "Started kubelet" Jul 24 09:56:45.988864 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.988840 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 09:56:45.988864 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.988844 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 09:56:45.988947 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.988893 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 09:56:45.989603 ip-10-0-131-23 systemd[1]: Started Kubernetes Kubelet. Jul 24 09:56:45.990861 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.990846 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 24 09:56:45.991147 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.991131 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 09:56:45.993748 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:45.993726 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 09:56:45.996987 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:45.996972 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 09:56:45.998150 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:45.996997 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-23.ec2.internal.18c53146742b3db8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-23.ec2.internal,UID:ip-10-0-131-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-23.ec2.internal,},FirstTimestamp:2026-07-24 09:56:45.988732344 +0000 UTC m=+0.398219412,LastTimestamp:2026-07-24 09:56:45.988732344 +0000 UTC m=+0.398219412,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-23.ec2.internal,}" Jul 24 09:56:46.000538 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.000525 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 09:56:46.000599 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.000539 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 09:56:46.000656 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.000633 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.001383 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001365 2563 factory.go:55] Registering systemd factory Jul 24 09:56:46.001383 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001386 2563 factory.go:223] Registration of the systemd container factory successfully Jul 24 09:56:46.001518 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001391 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 09:56:46.001518 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001393 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 09:56:46.001618 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001415 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 09:56:46.001718 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001704 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 24 09:56:46.001718 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001717 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 24 09:56:46.001920 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001875 2563 factory.go:153] Registering CRI-O factory Jul 24 09:56:46.001920 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001893 2563 factory.go:223] Registration of the crio container factory successfully Jul 24 09:56:46.002034 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001943 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 09:56:46.002034 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001972 2563 factory.go:103] Registering Raw factory Jul 24 09:56:46.002034 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.001987 2563 manager.go:1196] Started watching for new ooms in manager Jul 24 09:56:46.002477 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.002461 2563 manager.go:349] Starting recovery of all containers Jul 24 09:56:46.004070 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.004037 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 09:56:46.004339 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.004305 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 09:56:46.014081 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.014054 2563 manager.go:354] Recovery completed Jul 24 09:56:46.019414 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.019397 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:56:46.021387 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.021361 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:56:46.021454 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.021403 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:56:46.021454 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.021413 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:56:46.021928 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.021915 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 09:56:46.021928 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.021928 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 09:56:46.022022 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.021943 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 24 09:56:46.022022 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.021961 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:56:46.023417 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.023401 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:56:46.023471 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.023432 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:56:46.023471 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.023448 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:56:46.023865 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.023779 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-23.ec2.internal.18c53146761d861e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-23.ec2.internal,UID:ip-10-0-131-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-23.ec2.internal,},FirstTimestamp:2026-07-24 09:56:46.021387806 +0000 UTC m=+0.430874875,LastTimestamp:2026-07-24 09:56:46.021387806 +0000 UTC m=+0.430874875,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-23.ec2.internal,}" Jul 24 09:56:46.024779 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.024756 2563 policy_none.go:49] "None policy: Start" Jul 24 09:56:46.024817 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.024784 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 09:56:46.024817 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.024797 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 09:56:46.025492 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.025477 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-25d9r" Jul 24 09:56:46.026790 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.026779 2563 policy_none.go:47] "Start" Jul 24 09:56:46.033754 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.033530 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-23.ec2.internal.18c53146761dd4ef default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-23.ec2.internal,UID:ip-10-0-131-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-23.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-23.ec2.internal,},FirstTimestamp:2026-07-24 09:56:46.021407983 +0000 UTC m=+0.430895051,LastTimestamp:2026-07-24 09:56:46.021407983 +0000 UTC m=+0.430895051,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-23.ec2.internal,}" Jul 24 09:56:46.033837 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.033762 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-25d9r" Jul 24 09:56:46.065905 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.065880 2563 manager.go:337] "Starting Device Plugin manager" Jul 24 09:56:46.066029 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.065916 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 09:56:46.066029 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.065929 2563 server.go:87] "Starting device plugin registration server" Jul 24 09:56:46.066266 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.066222 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 09:56:46.066382 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.066256 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 09:56:46.066382 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.066345 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 09:56:46.066488 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.066451 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 09:56:46.066488 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.066465 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 09:56:46.066967 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.066948 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 09:56:46.067034 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.066996 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.080303 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.080281 2563 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2595 into the system container \"/system.slice\": " Jul 24 09:56:46.164821 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.164735 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 09:56:46.167114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.166081 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 09:56:46.167114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.166129 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 09:56:46.167114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.166156 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 09:56:46.167114 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.166201 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 09:56:46.167114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.166340 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:56:46.167381 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.167363 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:56:46.167422 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.167396 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:56:46.167422 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.167406 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:56:46.167480 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.167434 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.169475 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.169456 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:56:46.182244 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.182211 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.182341 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.182254 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-23.ec2.internal\": node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.229783 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.229755 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.266882 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.266831 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal"] Jul 24 09:56:46.266964 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.266930 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:56:46.270124 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.270109 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:56:46.270203 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.270136 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:56:46.270203 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.270146 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:56:46.272614 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.272602 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:56:46.272715 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.272698 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.272768 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.272735 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:56:46.273507 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.273486 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:56:46.273594 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.273519 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:56:46.273594 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.273526 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:56:46.273594 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.273549 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:56:46.273594 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.273558 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:56:46.273594 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.273532 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:56:46.275881 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.275864 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.275964 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.275889 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:56:46.278873 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.278857 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:56:46.278998 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.278891 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:56:46.278998 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.278901 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:56:46.295838 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.295814 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-23.ec2.internal\" not found" node="ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.301525 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.301508 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-23.ec2.internal\" not found" node="ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.304032 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.304004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a601e81bd2ad6ddab885bb95322a480-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal\" (UID: \"6a601e81bd2ad6ddab885bb95322a480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.304092 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.304040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ff7e6d6dc372649b853c14fc595bb8f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-23.ec2.internal\" (UID: \"3ff7e6d6dc372649b853c14fc595bb8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.304092 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.304057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a601e81bd2ad6ddab885bb95322a480-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal\" (UID: \"6a601e81bd2ad6ddab885bb95322a480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.330423 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.330395 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.405216 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.405183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a601e81bd2ad6ddab885bb95322a480-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal\" (UID: \"6a601e81bd2ad6ddab885bb95322a480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.405403 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.405221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a601e81bd2ad6ddab885bb95322a480-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal\" (UID: \"6a601e81bd2ad6ddab885bb95322a480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.405403 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.405271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ff7e6d6dc372649b853c14fc595bb8f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-23.ec2.internal\" (UID: \"3ff7e6d6dc372649b853c14fc595bb8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.405403 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.405277 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a601e81bd2ad6ddab885bb95322a480-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal\" (UID: \"6a601e81bd2ad6ddab885bb95322a480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.405403 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.405325 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ff7e6d6dc372649b853c14fc595bb8f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-23.ec2.internal\" (UID: \"3ff7e6d6dc372649b853c14fc595bb8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.405403 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.405344 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a601e81bd2ad6ddab885bb95322a480-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal\" (UID: \"6a601e81bd2ad6ddab885bb95322a480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.431513 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.431454 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.532248 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.532185 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.598421 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.598382 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.605375 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.605357 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal" Jul 24 09:56:46.632989 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.632952 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.733609 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.733524 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.833984 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.833957 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.918762 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.918738 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:56:46.935088 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.935057 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 09:56:46.935088 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:46.935069 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:46.935289 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.935214 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 09:56:46.935289 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:46.935262 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 09:56:47.035584 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:47.035520 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-23.ec2.internal\" not found" Jul 24 09:56:47.040670 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.040643 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 09:51:46 +0000 UTC" deadline="2028-02-08 10:15:14.662572513 +0000 UTC" Jul 24 09:56:47.040722 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.040675 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13536h18m27.621903068s" Jul 24 09:56:47.058289 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.058269 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:56:47.101441 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.101385 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" Jul 24 09:56:47.116204 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.116179 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 09:56:47.116985 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.116971 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal" Jul 24 09:56:47.124008 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.123978 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 09:56:47.188354 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:47.188319 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a601e81bd2ad6ddab885bb95322a480.slice/crio-5f0cb9253b82765c62f5e05cd9a392671645510320035a441ea175637d2cef09 WatchSource:0}: Error finding container 5f0cb9253b82765c62f5e05cd9a392671645510320035a441ea175637d2cef09: Status 404 returned error can't find the container with id 5f0cb9253b82765c62f5e05cd9a392671645510320035a441ea175637d2cef09 Jul 24 09:56:47.191966 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.191949 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 09:56:47.398725 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:47.398691 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff7e6d6dc372649b853c14fc595bb8f.slice/crio-c57faf94f77af8ed6e212d968d971b6d653fde9b3470b8d6d3d55a40565df3fb WatchSource:0}: Error finding container c57faf94f77af8ed6e212d968d971b6d653fde9b3470b8d6d3d55a40565df3fb: Status 404 returned error can't find the container with id c57faf94f77af8ed6e212d968d971b6d653fde9b3470b8d6d3d55a40565df3fb Jul 24 09:56:47.487947 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.487920 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:56:47.977982 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.977949 2563 apiserver.go:52] "Watching apiserver" Jul 24 09:56:47.985641 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.985614 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 09:56:47.986193 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.986170 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4jj2v","openshift-cluster-node-tuning-operator/tuned-8btcw","openshift-dns/node-resolver-hw722","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal","openshift-multus/multus-56flc","openshift-multus/network-metrics-daemon-ptzdc","kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6","openshift-image-registry/node-ca-mltsd","openshift-multus/multus-additional-cni-plugins-gm74q","openshift-network-diagnostics/network-check-target-mbz9f","openshift-network-operator/iptables-alerter-7zkzr","openshift-ovn-kubernetes/ovnkube-node-r8zhm","kube-system/global-pull-secret-syncer-xsj4t"] Jul 24 09:56:47.989302 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.989281 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:47.992167 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.991765 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:47.993467 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.993446 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 09:56:47.993807 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.993790 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2wphs\"" Jul 24 09:56:47.994037 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.994021 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 09:56:47.994366 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.994351 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 09:56:47.994856 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.994835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:47.995608 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.995590 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 09:56:47.995820 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.995804 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 09:56:47.996021 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.996004 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d8flz\"" Jul 24 09:56:47.999040 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.998846 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 09:56:48.000091 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.999533 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 09:56:48.000091 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:47.999936 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 09:56:48.001383 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.000654 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:56:48.001383 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.001007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jj2js\"" Jul 24 09:56:48.001383 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.001026 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 09:56:48.001383 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.001207 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 09:56:48.001383 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.001240 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 09:56:48.002042 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.002024 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 09:56:48.002935 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.002898 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56flc" Jul 24 09:56:48.006554 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.006533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:48.006677 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.006636 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:56:48.009024 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.008998 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 09:56:48.009351 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.009288 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 09:56:48.009781 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.009651 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 09:56:48.010053 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.010008 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fgjld\"" Jul 24 09:56:48.010271 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.010255 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c4w6n\"" Jul 24 09:56:48.010513 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.010497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 09:56:48.010730 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.010713 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.011197 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-hostroot\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-kubelet\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-node-log\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-cnibin\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-var-lib-cni-multus\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-daemon-config\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wb6\" (UniqueName: \"kubernetes.io/projected/7d9e1c55-0d7c-472d-a280-a625f562517c-kube-api-access-d6wb6\") pod \"node-ca-mltsd\" (UID: \"7d9e1c55-0d7c-472d-a280-a625f562517c\") " pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-systemd-units\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-ovnkube-config\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-cni-dir\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-cni-binary-copy\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6294891b-7363-45f6-87da-96321c389002-tmp\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-cni-netd\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-os-release\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.013281 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-var-lib-cni-bin\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-run-multus-certs\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-modprobe-d\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-slash\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-cni-bin\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-var-lib-kubelet\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-ovn-node-metrics-cert\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-system-cni-dir\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.012983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-systemd\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013014 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6294891b-7363-45f6-87da-96321c389002-etc-tuned\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-conf-dir\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013181 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-sysconfig\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wmxf\" (UniqueName: \"kubernetes.io/projected/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-kube-api-access-4wmxf\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6zq9\" (UniqueName: \"kubernetes.io/projected/6294891b-7363-45f6-87da-96321c389002-kube-api-access-c6zq9\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-run-k8s-cni-cncf-io\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-lib-modules\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-env-overrides\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.014221 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-socket-dir-parent\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-etc-kubernetes\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-kubernetes\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-host\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-run-openvswitch\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-var-lib-openvswitch\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013732 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shwlz\" (UniqueName: \"kubernetes.io/projected/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-kube-api-access-shwlz\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-run-systemd\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-sys\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d9e1c55-0d7c-472d-a280-a625f562517c-host\") pod \"node-ca-mltsd\" (UID: \"7d9e1c55-0d7c-472d-a280-a625f562517c\") " pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.013949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-var-lib-kubelet\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-log-socket\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-run-netns\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-ovnkube-script-lib\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f8c982d-76af-4557-b750-412e20b8f12a-agent-certs\") pod \"konnectivity-agent-4jj2v\" (UID: \"9f8c982d-76af-4557-b750-412e20b8f12a\") " pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-run-netns\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014193 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-sysctl-conf\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.015213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d9e1c55-0d7c-472d-a280-a625f562517c-serviceca\") pod \"node-ca-mltsd\" (UID: \"7d9e1c55-0d7c-472d-a280-a625f562517c\") " pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.016066 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014464 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-sysctl-d\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.016066 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-etc-openvswitch\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.016066 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014543 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-run-ovn\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.016066 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.016066 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014616 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-run\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.016066 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f8c982d-76af-4557-b750-412e20b8f12a-konnectivity-ca\") pod \"konnectivity-agent-4jj2v\" (UID: \"9f8c982d-76af-4557-b750-412e20b8f12a\") " pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:56:48.016066 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.014918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.018135 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.017321 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 09:56:48.018450 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.018428 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 09:56:48.018912 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.018869 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.019452 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.019382 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4ckq4\"" Jul 24 09:56:48.020074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.019913 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 09:56:48.023978 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.023962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.025984 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.025963 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 09:56:48.026251 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.026228 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 09:56:48.027361 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.026460 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hq8t9\"" Jul 24 09:56:48.027361 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.026865 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:48.027361 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.026919 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:56:48.027361 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.027205 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 09:56:48.027618 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.027585 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 09:56:48.027976 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.027950 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 09:56:48.028275 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.028248 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kxcc4\"" Jul 24 09:56:48.029031 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.029012 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.031777 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.031587 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 09:56:48.031883 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.031817 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 09:56:48.031883 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.031837 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sl4jh\"" Jul 24 09:56:48.032571 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.032554 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.032806 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.032783 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:56:48.035074 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.035018 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 09:56:48.065731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.065704 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8gzvw" Jul 24 09:56:48.076379 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.076265 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8gzvw" Jul 24 09:56:48.103712 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.103626 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 09:56:48.115609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-kubelet\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.115609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-node-log\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.115609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115466 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-kubelet\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.115609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-cnibin\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.115609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.115609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115533 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-node-log\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.115609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-cnibin\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.115609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115591 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-cnibin\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.116229 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-var-lib-cni-multus\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.116229 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-daemon-config\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.116229 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.115701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wb6\" (UniqueName: \"kubernetes.io/projected/7d9e1c55-0d7c-472d-a280-a625f562517c-kube-api-access-d6wb6\") pod \"node-ca-mltsd\" (UID: \"7d9e1c55-0d7c-472d-a280-a625f562517c\") " pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.116474 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-systemd-units\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.116474 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.116474 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-ovnkube-config\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.116645 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116498 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.116645 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-cni-dir\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.116645 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116560 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-cni-binary-copy\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.116645 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116585 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6294891b-7363-45f6-87da-96321c389002-tmp\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.116645 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-cni-netd\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.116645 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-os-release\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.116940 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116665 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-var-lib-cni-bin\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.116940 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116678 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-cni-dir\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.116940 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-run-multus-certs\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.116940 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npsrb\" (UniqueName: \"kubernetes.io/projected/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-kube-api-access-npsrb\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.116940 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.116940 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.116940 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-modprobe-d\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.116940 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-slash\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.116940 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-cni-bin\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-var-lib-kubelet\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.116974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-system-cni-dir\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55b645c3-4f1e-40cc-88ce-a2809ea86e0e-iptables-alerter-script\") pod \"iptables-alerter-7zkzr\" (UID: \"55b645c3-4f1e-40cc-88ce-a2809ea86e0e\") " pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117095 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55b645c3-4f1e-40cc-88ce-a2809ea86e0e-host-slash\") pod \"iptables-alerter-7zkzr\" (UID: \"55b645c3-4f1e-40cc-88ce-a2809ea86e0e\") " pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-registration-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-ovn-node-metrics-cert\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-system-cni-dir\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-systemd\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6294891b-7363-45f6-87da-96321c389002-etc-tuned\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjd9\" (UniqueName: \"kubernetes.io/projected/55b645c3-4f1e-40cc-88ce-a2809ea86e0e-kube-api-access-tzjd9\") pod \"iptables-alerter-7zkzr\" (UID: \"55b645c3-4f1e-40cc-88ce-a2809ea86e0e\") " pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.117282 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51252953-771c-415b-ac0c-aeda706ffb9c-hosts-file\") pod \"node-resolver-hw722\" (UID: \"51252953-771c-415b-ac0c-aeda706ffb9c\") " pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.117865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-conf-dir\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.117865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76dwt\" (UniqueName: \"kubernetes.io/projected/9eb06806-375e-4ad6-843e-2776aa98216c-kube-api-access-76dwt\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:48.117865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-sysconfig\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.117865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wmxf\" (UniqueName: \"kubernetes.io/projected/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-kube-api-access-4wmxf\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.117865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51252953-771c-415b-ac0c-aeda706ffb9c-tmp-dir\") pod \"node-resolver-hw722\" (UID: \"51252953-771c-415b-ac0c-aeda706ffb9c\") " pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.117865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx5lq\" (UniqueName: \"kubernetes.io/projected/51252953-771c-415b-ac0c-aeda706ffb9c-kube-api-access-vx5lq\") pod \"node-resolver-hw722\" (UID: \"51252953-771c-415b-ac0c-aeda706ffb9c\") " pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.117865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117485 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-modprobe-d\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.117865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117503 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6zq9\" (UniqueName: \"kubernetes.io/projected/6294891b-7363-45f6-87da-96321c389002-kube-api-access-c6zq9\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.117865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117655 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-var-lib-cni-bin\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.118359 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.117935 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 09:56:48.118359 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118087 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-cni-binary-copy\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.118493 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118373 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-systemd-units\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.118493 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118426 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-daemon-config\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.118493 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118444 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-os-release\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.118644 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118502 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-cni-netd\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.118644 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118543 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-var-lib-cni-multus\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.118751 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118619 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-ovnkube-config\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.118751 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118704 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-sysconfig\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.118849 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118822 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-run-k8s-cni-cncf-io\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.118902 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-kubelet-config\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.118902 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.119060 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-lib-modules\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.119060 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118961 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-env-overrides\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.119060 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118992 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-system-cni-dir\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.119060 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.118989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-socket-dir-parent\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.119279 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119076 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-socket-dir-parent\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.119279 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119117 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-run-k8s-cni-cncf-io\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.119279 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-etc-kubernetes\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.119279 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.119279 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-sys-fs\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.119279 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-kubernetes\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.119279 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-host\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-run-openvswitch\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8fhg\" (UniqueName: \"kubernetes.io/projected/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-kube-api-access-p8fhg\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-var-lib-openvswitch\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shwlz\" (UniqueName: \"kubernetes.io/projected/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-kube-api-access-shwlz\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119397 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-os-release\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119426 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-env-overrides\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-run-systemd\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-sys\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d9e1c55-0d7c-472d-a280-a625f562517c-host\") pod \"node-ca-mltsd\" (UID: \"7d9e1c55-0d7c-472d-a280-a625f562517c\") " pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-var-lib-kubelet\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-log-socket\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-socket-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-run-netns\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.119731 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119734 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-ovnkube-script-lib\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f8c982d-76af-4557-b750-412e20b8f12a-agent-certs\") pod \"konnectivity-agent-4jj2v\" (UID: \"9f8c982d-76af-4557-b750-412e20b8f12a\") " pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-run-netns\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-dbus\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-sysctl-conf\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d9e1c55-0d7c-472d-a280-a625f562517c-serviceca\") pod \"node-ca-mltsd\" (UID: \"7d9e1c55-0d7c-472d-a280-a625f562517c\") " pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-sysctl-d\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-etc-openvswitch\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.119978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-run-ovn\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-run\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120147 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-run-ovn\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f8c982d-76af-4557-b750-412e20b8f12a-konnectivity-ca\") pod \"konnectivity-agent-4jj2v\" (UID: \"9f8c982d-76af-4557-b750-412e20b8f12a\") " pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-hostroot\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-device-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.120448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120301 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-sysctl-conf\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120331 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120378 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-run-multus-certs\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120416 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-cni-bin\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120450 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-multus-conf-dir\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120479 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-slash\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120511 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-etc-kubernetes\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120563 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-kubernetes\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120604 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-host\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120637 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-run-openvswitch\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120684 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-var-lib-openvswitch\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120739 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d9e1c55-0d7c-472d-a280-a625f562517c-serviceca\") pod \"node-ca-mltsd\" (UID: \"7d9e1c55-0d7c-472d-a280-a625f562517c\") " pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120875 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-lib-modules\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120940 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-run-systemd\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120944 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-systemd\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120983 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-sys\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.120982 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-var-lib-kubelet\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121022 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d9e1c55-0d7c-472d-a280-a625f562517c-host\") pod \"node-ca-mltsd\" (UID: \"7d9e1c55-0d7c-472d-a280-a625f562517c\") " pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.121300 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121031 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-etc-openvswitch\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.122176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121068 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-host-run-netns\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.122176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121107 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-log-socket\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.122176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121154 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-etc-sysctl-d\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.122176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121158 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-run\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.122176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121193 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-host-run-netns\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.122176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121738 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-ovnkube-script-lib\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.122176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121761 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f8c982d-76af-4557-b750-412e20b8f12a-konnectivity-ca\") pod \"konnectivity-agent-4jj2v\" (UID: \"9f8c982d-76af-4557-b750-412e20b8f12a\") " pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:56:48.122176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121820 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-hostroot\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.122176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.121872 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6294891b-7363-45f6-87da-96321c389002-var-lib-kubelet\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.128424 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.128353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6294891b-7363-45f6-87da-96321c389002-etc-tuned\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.128817 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.128770 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6294891b-7363-45f6-87da-96321c389002-tmp\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.129360 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.129263 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-ovn-node-metrics-cert\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.130191 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.130167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shwlz\" (UniqueName: \"kubernetes.io/projected/9b7e7e9c-823b-4a00-aae8-c66e1f513ca3-kube-api-access-shwlz\") pod \"ovnkube-node-r8zhm\" (UID: \"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.131879 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.131769 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6zq9\" (UniqueName: \"kubernetes.io/projected/6294891b-7363-45f6-87da-96321c389002-kube-api-access-c6zq9\") pod \"tuned-8btcw\" (UID: \"6294891b-7363-45f6-87da-96321c389002\") " pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.131879 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.131833 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wb6\" (UniqueName: \"kubernetes.io/projected/7d9e1c55-0d7c-472d-a280-a625f562517c-kube-api-access-d6wb6\") pod \"node-ca-mltsd\" (UID: \"7d9e1c55-0d7c-472d-a280-a625f562517c\") " pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.132284 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.132266 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wmxf\" (UniqueName: \"kubernetes.io/projected/06766f9a-f37b-424e-a5b0-00ab7cf2d0d1-kube-api-access-4wmxf\") pod \"multus-56flc\" (UID: \"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1\") " pod="openshift-multus/multus-56flc" Jul 24 09:56:48.133297 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.133154 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f8c982d-76af-4557-b750-412e20b8f12a-agent-certs\") pod \"konnectivity-agent-4jj2v\" (UID: \"9f8c982d-76af-4557-b750-412e20b8f12a\") " pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:56:48.173794 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.173729 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal" event={"ID":"3ff7e6d6dc372649b853c14fc595bb8f","Type":"ContainerStarted","Data":"c57faf94f77af8ed6e212d968d971b6d653fde9b3470b8d6d3d55a40565df3fb"} Jul 24 09:56:48.177122 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.177086 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" event={"ID":"6a601e81bd2ad6ddab885bb95322a480","Type":"ContainerStarted","Data":"5f0cb9253b82765c62f5e05cd9a392671645510320035a441ea175637d2cef09"} Jul 24 09:56:48.221171 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51252953-771c-415b-ac0c-aeda706ffb9c-tmp-dir\") pod \"node-resolver-hw722\" (UID: \"51252953-771c-415b-ac0c-aeda706ffb9c\") " pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.221399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx5lq\" (UniqueName: \"kubernetes.io/projected/51252953-771c-415b-ac0c-aeda706ffb9c-kube-api-access-vx5lq\") pod \"node-resolver-hw722\" (UID: \"51252953-771c-415b-ac0c-aeda706ffb9c\") " pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.221399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-kubelet-config\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.221399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.221399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.221399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221315 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-sys-fs\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.221399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8fhg\" (UniqueName: \"kubernetes.io/projected/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-kube-api-access-p8fhg\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.221399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-os-release\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.221399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:48.221850 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-socket-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.221850 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221449 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-dbus\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.221850 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.221850 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221501 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.221850 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-device-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.221850 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.221850 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-cnibin\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.221850 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221609 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51252953-771c-415b-ac0c-aeda706ffb9c-tmp-dir\") pod \"node-resolver-hw722\" (UID: \"51252953-771c-415b-ac0c-aeda706ffb9c\") " pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.221850 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npsrb\" (UniqueName: \"kubernetes.io/projected/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-kube-api-access-npsrb\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.222361 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.221855 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-kubelet-config\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.222361 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222006 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-device-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.222361 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222044 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-dbus\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.222361 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.222113 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:48.222361 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.222186 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret podName:d853ec2c-9dca-41db-b642-4ae5d6dc99c8 nodeName:}" failed. No retries permitted until 2026-07-24 09:56:48.7221619 +0000 UTC m=+3.131648958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret") pod "global-pull-secret-syncer-xsj4t" (UID: "d853ec2c-9dca-41db-b642-4ae5d6dc99c8") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:48.222361 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222190 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-socket-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.222361 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222299 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-cnibin\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.222822 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222414 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.222822 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222509 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.222822 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222542 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.222822 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222581 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-sys-fs\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.222822 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222648 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-os-release\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.222822 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222793 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222925 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-system-cni-dir\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.222956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55b645c3-4f1e-40cc-88ce-a2809ea86e0e-iptables-alerter-script\") pod \"iptables-alerter-7zkzr\" (UID: \"55b645c3-4f1e-40cc-88ce-a2809ea86e0e\") " pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55b645c3-4f1e-40cc-88ce-a2809ea86e0e-host-slash\") pod \"iptables-alerter-7zkzr\" (UID: \"55b645c3-4f1e-40cc-88ce-a2809ea86e0e\") " pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-registration-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223032 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-system-cni-dir\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjd9\" (UniqueName: \"kubernetes.io/projected/55b645c3-4f1e-40cc-88ce-a2809ea86e0e-kube-api-access-tzjd9\") pod \"iptables-alerter-7zkzr\" (UID: \"55b645c3-4f1e-40cc-88ce-a2809ea86e0e\") " pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223092 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55b645c3-4f1e-40cc-88ce-a2809ea86e0e-host-slash\") pod \"iptables-alerter-7zkzr\" (UID: \"55b645c3-4f1e-40cc-88ce-a2809ea86e0e\") " pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51252953-771c-415b-ac0c-aeda706ffb9c-hosts-file\") pod \"node-resolver-hw722\" (UID: \"51252953-771c-415b-ac0c-aeda706ffb9c\") " pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.223142 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76dwt\" (UniqueName: \"kubernetes.io/projected/9eb06806-375e-4ad6-843e-2776aa98216c-kube-api-access-76dwt\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:48.223799 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223137 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.223799 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223236 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51252953-771c-415b-ac0c-aeda706ffb9c-hosts-file\") pod \"node-resolver-hw722\" (UID: \"51252953-771c-415b-ac0c-aeda706ffb9c\") " pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.223799 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223431 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-registration-dir\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.223799 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.223537 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:48.223799 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.223587 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs podName:9eb06806-375e-4ad6-843e-2776aa98216c nodeName:}" failed. No retries permitted until 2026-07-24 09:56:48.723569282 +0000 UTC m=+3.133056355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs") pod "network-metrics-daemon-ptzdc" (UID: "9eb06806-375e-4ad6-843e-2776aa98216c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:48.223799 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223623 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.223799 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.223673 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55b645c3-4f1e-40cc-88ce-a2809ea86e0e-iptables-alerter-script\") pod \"iptables-alerter-7zkzr\" (UID: \"55b645c3-4f1e-40cc-88ce-a2809ea86e0e\") " pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.232448 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.232379 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npsrb\" (UniqueName: \"kubernetes.io/projected/d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a-kube-api-access-npsrb\") pod \"multus-additional-cni-plugins-gm74q\" (UID: \"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a\") " pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.233514 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.233278 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:56:48.233514 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.233296 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:56:48.233514 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.233331 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6z9d5 for pod openshift-network-diagnostics/network-check-target-mbz9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:48.233514 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.233393 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5 podName:4659c7c2-c649-4d08-ad8d-67c9b955c4ea nodeName:}" failed. No retries permitted until 2026-07-24 09:56:48.733379031 +0000 UTC m=+3.142866103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6z9d5" (UniqueName: "kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5") pod "network-check-target-mbz9f" (UID: "4659c7c2-c649-4d08-ad8d-67c9b955c4ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:48.238829 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.238780 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8fhg\" (UniqueName: \"kubernetes.io/projected/6951bb6d-4125-4b3d-b43b-8267b3cf78fd-kube-api-access-p8fhg\") pod \"aws-ebs-csi-driver-node-8wsr6\" (UID: \"6951bb6d-4125-4b3d-b43b-8267b3cf78fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.240707 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.240678 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76dwt\" (UniqueName: \"kubernetes.io/projected/9eb06806-375e-4ad6-843e-2776aa98216c-kube-api-access-76dwt\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:48.241286 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.241229 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjd9\" (UniqueName: \"kubernetes.io/projected/55b645c3-4f1e-40cc-88ce-a2809ea86e0e-kube-api-access-tzjd9\") pod \"iptables-alerter-7zkzr\" (UID: \"55b645c3-4f1e-40cc-88ce-a2809ea86e0e\") " pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.242671 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.242628 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx5lq\" (UniqueName: \"kubernetes.io/projected/51252953-771c-415b-ac0c-aeda706ffb9c-kube-api-access-vx5lq\") pod \"node-resolver-hw722\" (UID: \"51252953-771c-415b-ac0c-aeda706ffb9c\") " pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.305837 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.305796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mltsd" Jul 24 09:56:48.318218 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.318160 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8btcw" Jul 24 09:56:48.336633 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.336603 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:56:48.341910 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.341878 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:56:48.350072 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.350044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56flc" Jul 24 09:56:48.360124 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.360100 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7zkzr" Jul 24 09:56:48.368465 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.368286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gm74q" Jul 24 09:56:48.376337 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.376314 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" Jul 24 09:56:48.387309 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.387283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hw722" Jul 24 09:56:48.417644 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.417617 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:56:48.727382 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.727334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:48.727609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.727450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:48.727609 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.727531 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:48.727609 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.727565 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:48.727755 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.727620 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs podName:9eb06806-375e-4ad6-843e-2776aa98216c nodeName:}" failed. No retries permitted until 2026-07-24 09:56:49.727595313 +0000 UTC m=+4.137082388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs") pod "network-metrics-daemon-ptzdc" (UID: "9eb06806-375e-4ad6-843e-2776aa98216c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:48.727755 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.727644 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret podName:d853ec2c-9dca-41db-b642-4ae5d6dc99c8 nodeName:}" failed. No retries permitted until 2026-07-24 09:56:49.727630838 +0000 UTC m=+4.137117902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret") pod "global-pull-secret-syncer-xsj4t" (UID: "d853ec2c-9dca-41db-b642-4ae5d6dc99c8") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:48.812551 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.812515 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:56:48.828247 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:48.828195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:48.828419 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.828379 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:56:48.828419 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.828411 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:56:48.828548 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.828425 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6z9d5 for pod openshift-network-diagnostics/network-check-target-mbz9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:48.828548 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:48.828508 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5 podName:4659c7c2-c649-4d08-ad8d-67c9b955c4ea nodeName:}" failed. No retries permitted until 2026-07-24 09:56:49.828488218 +0000 UTC m=+4.237975276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6z9d5" (UniqueName: "kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5") pod "network-check-target-mbz9f" (UID: "4659c7c2-c649-4d08-ad8d-67c9b955c4ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:49.079925 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:49.079862 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 09:51:48 +0000 UTC" deadline="2028-03-14 14:22:35.053017768 +0000 UTC" Jul 24 09:56:49.079925 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:49.079922 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14380h25m45.973100744s" Jul 24 09:56:49.316891 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:49.316700 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7e7e9c_823b_4a00_aae8_c66e1f513ca3.slice/crio-c1f323e63146635e7a89a8a9df8a9799f01fb5bccb4d8b90e642c1506d04b060 WatchSource:0}: Error finding container c1f323e63146635e7a89a8a9df8a9799f01fb5bccb4d8b90e642c1506d04b060: Status 404 returned error can't find the container with id c1f323e63146635e7a89a8a9df8a9799f01fb5bccb4d8b90e642c1506d04b060 Jul 24 09:56:49.321884 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:49.321835 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51252953_771c_415b_ac0c_aeda706ffb9c.slice/crio-a77335f613a89d8414eebef2bb24e3814383ae47550cd31692da48172100dfa0 WatchSource:0}: Error finding container a77335f613a89d8414eebef2bb24e3814383ae47550cd31692da48172100dfa0: Status 404 returned error can't find the container with id a77335f613a89d8414eebef2bb24e3814383ae47550cd31692da48172100dfa0 Jul 24 09:56:49.323216 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:49.323186 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09d5c1f_c0bb_4f57_83ce_0cf4c3f4873a.slice/crio-a9cbf9a60c011e25e3fb63176c3aeea8a5dcd2b1a37b749290ed24505e90367d WatchSource:0}: Error finding container a9cbf9a60c011e25e3fb63176c3aeea8a5dcd2b1a37b749290ed24505e90367d: Status 404 returned error can't find the container with id a9cbf9a60c011e25e3fb63176c3aeea8a5dcd2b1a37b749290ed24505e90367d Jul 24 09:56:49.324677 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:49.324128 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6951bb6d_4125_4b3d_b43b_8267b3cf78fd.slice/crio-19bdded943f2ee2a2c4cdf8fd236ab0a6a424b4f317d0f9973b2cd7a48a36666 WatchSource:0}: Error finding container 19bdded943f2ee2a2c4cdf8fd236ab0a6a424b4f317d0f9973b2cd7a48a36666: Status 404 returned error can't find the container with id 19bdded943f2ee2a2c4cdf8fd236ab0a6a424b4f317d0f9973b2cd7a48a36666 Jul 24 09:56:49.326591 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:49.326556 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06766f9a_f37b_424e_a5b0_00ab7cf2d0d1.slice/crio-37e0f4fe8916a08fa29e875270107cff806d41dda5d7a13ccba66e984d584982 WatchSource:0}: Error finding container 37e0f4fe8916a08fa29e875270107cff806d41dda5d7a13ccba66e984d584982: Status 404 returned error can't find the container with id 37e0f4fe8916a08fa29e875270107cff806d41dda5d7a13ccba66e984d584982 Jul 24 09:56:49.328509 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:49.328490 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b645c3_4f1e_40cc_88ce_a2809ea86e0e.slice/crio-a9176df054d3d285bc1793807d3e1b861f238bb3cc76717f42870fb764f412d9 WatchSource:0}: Error finding container a9176df054d3d285bc1793807d3e1b861f238bb3cc76717f42870fb764f412d9: Status 404 returned error can't find the container with id a9176df054d3d285bc1793807d3e1b861f238bb3cc76717f42870fb764f412d9 Jul 24 09:56:49.329800 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:49.329772 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6294891b_7363_45f6_87da_96321c389002.slice/crio-273d8432188220450908f74ca33ab222ecfbed6141673c61382eb47a2547934c WatchSource:0}: Error finding container 273d8432188220450908f74ca33ab222ecfbed6141673c61382eb47a2547934c: Status 404 returned error can't find the container with id 273d8432188220450908f74ca33ab222ecfbed6141673c61382eb47a2547934c Jul 24 09:56:49.331955 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:56:49.331668 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9e1c55_0d7c_472d_a280_a625f562517c.slice/crio-dd29b90c2ebabaa74da7ae3c7791c8614cbef2670e2487b832aab5365e8c7325 WatchSource:0}: Error finding container dd29b90c2ebabaa74da7ae3c7791c8614cbef2670e2487b832aab5365e8c7325: Status 404 returned error can't find the container with id dd29b90c2ebabaa74da7ae3c7791c8614cbef2670e2487b832aab5365e8c7325 Jul 24 09:56:49.735572 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:49.735277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:49.735572 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:49.735557 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:49.735783 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:49.735606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:49.735783 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:49.735644 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret podName:d853ec2c-9dca-41db-b642-4ae5d6dc99c8 nodeName:}" failed. No retries permitted until 2026-07-24 09:56:51.735610343 +0000 UTC m=+6.145097415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret") pod "global-pull-secret-syncer-xsj4t" (UID: "d853ec2c-9dca-41db-b642-4ae5d6dc99c8") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:49.735783 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:49.735690 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:49.735783 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:49.735729 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs podName:9eb06806-375e-4ad6-843e-2776aa98216c nodeName:}" failed. No retries permitted until 2026-07-24 09:56:51.735716418 +0000 UTC m=+6.145203493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs") pod "network-metrics-daemon-ptzdc" (UID: "9eb06806-375e-4ad6-843e-2776aa98216c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:49.836636 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:49.836513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:49.836865 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:49.836728 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:56:49.836865 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:49.836746 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:56:49.836865 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:49.836774 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6z9d5 for pod openshift-network-diagnostics/network-check-target-mbz9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:49.836865 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:49.836849 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5 podName:4659c7c2-c649-4d08-ad8d-67c9b955c4ea nodeName:}" failed. No retries permitted until 2026-07-24 09:56:51.836816999 +0000 UTC m=+6.246304070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6z9d5" (UniqueName: "kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5") pod "network-check-target-mbz9f" (UID: "4659c7c2-c649-4d08-ad8d-67c9b955c4ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:50.080233 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.080143 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 09:51:48 +0000 UTC" deadline="2028-04-14 11:45:55.838595952 +0000 UTC" Jul 24 09:56:50.080233 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.080185 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15121h49m5.758416315s" Jul 24 09:56:50.168633 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.168450 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:50.168633 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.168461 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:50.168633 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:50.168593 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:56:50.168633 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.168633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:50.168950 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:50.168741 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:56:50.168950 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:50.168827 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:56:50.188331 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.188236 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal" event={"ID":"3ff7e6d6dc372649b853c14fc595bb8f","Type":"ContainerStarted","Data":"ec540674e6715d40c71ff9a9b91cb2288005ba78d636e514aecd43a2c454ac3a"} Jul 24 09:56:50.192104 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.192034 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jj2v" event={"ID":"9f8c982d-76af-4557-b750-412e20b8f12a","Type":"ContainerStarted","Data":"a050f0b2ed958b13f46519d86cedee6d2db12aa7a864c99ef3e7ba00ab137adf"} Jul 24 09:56:50.195220 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.195088 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7zkzr" event={"ID":"55b645c3-4f1e-40cc-88ce-a2809ea86e0e","Type":"ContainerStarted","Data":"a9176df054d3d285bc1793807d3e1b861f238bb3cc76717f42870fb764f412d9"} Jul 24 09:56:50.202769 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.202689 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" event={"ID":"6951bb6d-4125-4b3d-b43b-8267b3cf78fd","Type":"ContainerStarted","Data":"19bdded943f2ee2a2c4cdf8fd236ab0a6a424b4f317d0f9973b2cd7a48a36666"} Jul 24 09:56:50.213922 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.212136 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hw722" event={"ID":"51252953-771c-415b-ac0c-aeda706ffb9c","Type":"ContainerStarted","Data":"a77335f613a89d8414eebef2bb24e3814383ae47550cd31692da48172100dfa0"} Jul 24 09:56:50.237665 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.237509 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" event={"ID":"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3","Type":"ContainerStarted","Data":"c1f323e63146635e7a89a8a9df8a9799f01fb5bccb4d8b90e642c1506d04b060"} Jul 24 09:56:50.253910 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.253220 2563 generic.go:356] "Generic (PLEG): container finished" podID="6a601e81bd2ad6ddab885bb95322a480" containerID="5728de09d567ed9ebd6ce2f231620bbbfe7b283e63eb5c2b65cbf19c855f8df2" exitCode=0 Jul 24 09:56:50.253910 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.253371 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" event={"ID":"6a601e81bd2ad6ddab885bb95322a480","Type":"ContainerDied","Data":"5728de09d567ed9ebd6ce2f231620bbbfe7b283e63eb5c2b65cbf19c855f8df2"} Jul 24 09:56:50.269571 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.269494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mltsd" event={"ID":"7d9e1c55-0d7c-472d-a280-a625f562517c","Type":"ContainerStarted","Data":"dd29b90c2ebabaa74da7ae3c7791c8614cbef2670e2487b832aab5365e8c7325"} Jul 24 09:56:50.273013 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.272934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8btcw" event={"ID":"6294891b-7363-45f6-87da-96321c389002","Type":"ContainerStarted","Data":"273d8432188220450908f74ca33ab222ecfbed6141673c61382eb47a2547934c"} Jul 24 09:56:50.275202 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.275128 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56flc" event={"ID":"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1","Type":"ContainerStarted","Data":"37e0f4fe8916a08fa29e875270107cff806d41dda5d7a13ccba66e984d584982"} Jul 24 09:56:50.278587 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.277817 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-23.ec2.internal" podStartSLOduration=3.277801998 podStartE2EDuration="3.277801998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:56:50.213901316 +0000 UTC m=+4.623388398" watchObservedRunningTime="2026-07-24 09:56:50.277801998 +0000 UTC m=+4.687289080" Jul 24 09:56:50.278711 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:50.278586 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm74q" event={"ID":"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a","Type":"ContainerStarted","Data":"a9cbf9a60c011e25e3fb63176c3aeea8a5dcd2b1a37b749290ed24505e90367d"} Jul 24 09:56:51.307547 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:51.307502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" event={"ID":"6a601e81bd2ad6ddab885bb95322a480","Type":"ContainerStarted","Data":"02264e96cc86d55828d446b39af820fada590b117ee18f941a232ccc3828f61f"} Jul 24 09:56:51.766006 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:51.765860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:51.766006 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:51.765935 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:51.766275 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:51.766080 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:51.766275 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:51.766146 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs podName:9eb06806-375e-4ad6-843e-2776aa98216c nodeName:}" failed. No retries permitted until 2026-07-24 09:56:55.766126327 +0000 UTC m=+10.175613387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs") pod "network-metrics-daemon-ptzdc" (UID: "9eb06806-375e-4ad6-843e-2776aa98216c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:51.766627 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:51.766607 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:51.766721 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:51.766667 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret podName:d853ec2c-9dca-41db-b642-4ae5d6dc99c8 nodeName:}" failed. No retries permitted until 2026-07-24 09:56:55.766650661 +0000 UTC m=+10.176137722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret") pod "global-pull-secret-syncer-xsj4t" (UID: "d853ec2c-9dca-41db-b642-4ae5d6dc99c8") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:51.867132 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:51.867083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:51.867356 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:51.867283 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:56:51.867356 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:51.867304 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:56:51.867356 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:51.867317 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6z9d5 for pod openshift-network-diagnostics/network-check-target-mbz9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:51.867515 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:51.867379 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5 podName:4659c7c2-c649-4d08-ad8d-67c9b955c4ea nodeName:}" failed. No retries permitted until 2026-07-24 09:56:55.867359292 +0000 UTC m=+10.276846365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6z9d5" (UniqueName: "kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5") pod "network-check-target-mbz9f" (UID: "4659c7c2-c649-4d08-ad8d-67c9b955c4ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:52.169272 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:52.169193 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:52.169473 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:52.169342 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:56:52.169473 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:52.169455 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:52.169574 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:52.169462 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:52.169574 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:52.169559 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:56:52.169689 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:52.169660 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:56:54.166586 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:54.166542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:54.167063 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:54.166701 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:56:54.167134 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:54.167106 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:54.167263 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:54.167219 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:56:54.167377 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:54.167308 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:54.167377 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:54.167369 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:56:55.807159 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:55.807108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:55.807643 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:55.807179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:55.807643 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:55.807321 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:55.807643 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:55.807380 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs podName:9eb06806-375e-4ad6-843e-2776aa98216c nodeName:}" failed. No retries permitted until 2026-07-24 09:57:03.807360979 +0000 UTC m=+18.216848040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs") pod "network-metrics-daemon-ptzdc" (UID: "9eb06806-375e-4ad6-843e-2776aa98216c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:56:55.807821 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:55.807744 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:55.807821 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:55.807790 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret podName:d853ec2c-9dca-41db-b642-4ae5d6dc99c8 nodeName:}" failed. No retries permitted until 2026-07-24 09:57:03.807776027 +0000 UTC m=+18.217263086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret") pod "global-pull-secret-syncer-xsj4t" (UID: "d853ec2c-9dca-41db-b642-4ae5d6dc99c8") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:56:55.908094 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:55.908046 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:55.908320 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:55.908225 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:56:55.908320 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:55.908269 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:56:55.908320 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:55.908283 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6z9d5 for pod openshift-network-diagnostics/network-check-target-mbz9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:55.908488 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:55.908346 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5 podName:4659c7c2-c649-4d08-ad8d-67c9b955c4ea nodeName:}" failed. No retries permitted until 2026-07-24 09:57:03.908327044 +0000 UTC m=+18.317814116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6z9d5" (UniqueName: "kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5") pod "network-check-target-mbz9f" (UID: "4659c7c2-c649-4d08-ad8d-67c9b955c4ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:56:56.167752 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:56.167677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:56.167891 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:56.167789 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:56:56.168186 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:56.168172 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:56.168275 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:56.168260 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:56:56.168314 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:56.168306 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:56.168369 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:56.168356 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:56:58.168959 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:58.168922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:56:58.169437 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:58.169055 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:56:58.169499 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:58.169459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:56:58.169581 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:58.169559 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:56:58.169642 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:56:58.169608 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:56:58.169693 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:56:58.169671 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:00.167096 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:00.167054 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:00.167579 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:00.167191 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:00.167657 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:00.167632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:00.167792 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:00.167724 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:00.167880 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:00.167863 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:00.167976 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:00.167958 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:02.167444 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:02.167406 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:02.167444 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:02.167430 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:02.167946 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:02.167542 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:02.167946 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:02.167567 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:02.167946 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:02.167651 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:02.167946 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:02.167736 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:03.866350 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:03.866303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:03.866869 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:03.866372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:03.866869 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:03.866486 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:57:03.866869 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:03.866495 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:57:03.866869 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:03.866563 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret podName:d853ec2c-9dca-41db-b642-4ae5d6dc99c8 nodeName:}" failed. No retries permitted until 2026-07-24 09:57:19.866546529 +0000 UTC m=+34.276033604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret") pod "global-pull-secret-syncer-xsj4t" (UID: "d853ec2c-9dca-41db-b642-4ae5d6dc99c8") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:57:03.866869 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:03.866580 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs podName:9eb06806-375e-4ad6-843e-2776aa98216c nodeName:}" failed. No retries permitted until 2026-07-24 09:57:19.866573099 +0000 UTC m=+34.276060153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs") pod "network-metrics-daemon-ptzdc" (UID: "9eb06806-375e-4ad6-843e-2776aa98216c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:57:03.967429 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:03.967377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:03.967601 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:03.967572 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:57:03.967601 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:03.967594 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:57:03.967676 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:03.967604 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6z9d5 for pod openshift-network-diagnostics/network-check-target-mbz9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:57:03.967676 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:03.967659 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5 podName:4659c7c2-c649-4d08-ad8d-67c9b955c4ea nodeName:}" failed. No retries permitted until 2026-07-24 09:57:19.967645489 +0000 UTC m=+34.377132548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6z9d5" (UniqueName: "kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5") pod "network-check-target-mbz9f" (UID: "4659c7c2-c649-4d08-ad8d-67c9b955c4ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:57:04.167222 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:04.167132 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:04.167222 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:04.167173 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:04.167459 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:04.167279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:04.167459 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:04.167287 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:04.167459 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:04.167352 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:04.167612 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:04.167459 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:06.168264 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:06.168218 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:06.168685 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:06.168270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:06.168685 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:06.168352 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:06.168685 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:06.168387 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:06.168685 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:06.168425 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:06.168685 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:06.168474 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:08.166639 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:08.166601 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:08.167158 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:08.166601 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:08.167158 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:08.166738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:08.167158 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:08.166731 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:08.167158 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:08.166863 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:08.167158 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:08.166980 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:09.354857 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.354384 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jj2v" event={"ID":"9f8c982d-76af-4557-b750-412e20b8f12a","Type":"ContainerStarted","Data":"490330ea8e8f5e950817d59528f3a0aec41f117cb1248549f20df823beaa20c1"} Jul 24 09:57:09.355956 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.355928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" event={"ID":"6951bb6d-4125-4b3d-b43b-8267b3cf78fd","Type":"ContainerStarted","Data":"f3c7d713365d97eaee50633719f488cbf852f87553d689dcbaf550cfce9a1ff7"} Jul 24 09:57:09.357449 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.357400 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hw722" event={"ID":"51252953-771c-415b-ac0c-aeda706ffb9c","Type":"ContainerStarted","Data":"70669a59609f0edc52a0ee168591af46d4cd4f3d093666a9e3f7cf809598de64"} Jul 24 09:57:09.363543 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.363510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" event={"ID":"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3","Type":"ContainerStarted","Data":"79a522fd18c5242544f91bae805166fd67cd4c27b4eb4fb6b3838a78c1b7690b"} Jul 24 09:57:09.363661 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.363621 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" event={"ID":"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3","Type":"ContainerStarted","Data":"37e2d4bd4bb491d30478c4083abc93332e05aed1327bdf5dca7553786769cb63"} Jul 24 09:57:09.363722 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.363664 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" event={"ID":"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3","Type":"ContainerStarted","Data":"f111737bde94e608624768a98908b76d541086efc7352653ee0db83a956a4c30"} Jul 24 09:57:09.363722 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.363693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" event={"ID":"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3","Type":"ContainerStarted","Data":"fee023adbb593ebb5050dab51a010e534ef31c74b1afb7ff7d4eb99089994738"} Jul 24 09:57:09.363820 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.363722 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" event={"ID":"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3","Type":"ContainerStarted","Data":"1226d5622fb270dbe3c62aa78671d133d1e88479728f3e4e55359c8e4a458f2e"} Jul 24 09:57:09.363820 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.363766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" event={"ID":"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3","Type":"ContainerStarted","Data":"6c510cb3a42bc96cc3267033cf819d4ea34ead9f0a234078b3ec615001db4693"} Jul 24 09:57:09.365080 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.365057 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mltsd" event={"ID":"7d9e1c55-0d7c-472d-a280-a625f562517c","Type":"ContainerStarted","Data":"278f0516a35cf0b0f2bd010fb358b0d10f4904e53923c1bde91b23ae0a7e805f"} Jul 24 09:57:09.366511 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.366489 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8btcw" event={"ID":"6294891b-7363-45f6-87da-96321c389002","Type":"ContainerStarted","Data":"5ef6d954ba58a3a8e3b296f9b80251c449aae460612313496f4455e9ffae159b"} Jul 24 09:57:09.368032 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.368010 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56flc" event={"ID":"06766f9a-f37b-424e-a5b0-00ab7cf2d0d1","Type":"ContainerStarted","Data":"7cdf7f8377f5af03101cd355f96ac2eac67f8486435731f6632783173d00854a"} Jul 24 09:57:09.369601 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.369578 2563 generic.go:356] "Generic (PLEG): container finished" podID="d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a" containerID="f78e0c74a72535b6c5c8b1e13c6f016f17e187b047d8192cd90d6b647902e077" exitCode=0 Jul 24 09:57:09.369709 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.369613 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm74q" event={"ID":"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a","Type":"ContainerDied","Data":"f78e0c74a72535b6c5c8b1e13c6f016f17e187b047d8192cd90d6b647902e077"} Jul 24 09:57:09.375249 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.375191 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4jj2v" podStartSLOduration=12.190873324 podStartE2EDuration="23.375179312s" totalImagesPullingTime="11.184305988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:09.37502474 +0000 UTC m=+23.784511818" watchObservedRunningTime="2026-07-24 09:57:09.375179312 +0000 UTC m=+23.784666388" Jul 24 09:57:09.375422 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.375398 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-23.ec2.internal" podStartSLOduration=22.375392208 podStartE2EDuration="22.375392208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:56:51.329512692 +0000 UTC m=+5.738999771" watchObservedRunningTime="2026-07-24 09:57:09.375392208 +0000 UTC m=+23.784879284" Jul 24 09:57:09.397799 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.397740 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-56flc" podStartSLOduration=4.28654012 podStartE2EDuration="23.3977192s" totalImagesPullingTime="19.11117908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:09.39748931 +0000 UTC m=+23.806976388" watchObservedRunningTime="2026-07-24 09:57:09.3977192 +0000 UTC m=+23.807206276" Jul 24 09:57:09.466200 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.466148 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mltsd" podStartSLOduration=4.440316563 podStartE2EDuration="23.46613058s" totalImagesPullingTime="19.025814017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:09.466109313 +0000 UTC m=+23.875596390" watchObservedRunningTime="2026-07-24 09:57:09.46613058 +0000 UTC m=+23.875617657" Jul 24 09:57:09.466766 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.466728 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hw722" podStartSLOduration=3.409138952 podStartE2EDuration="22.466714917s" totalImagesPullingTime="19.057575965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:09.446601344 +0000 UTC m=+23.856088420" watchObservedRunningTime="2026-07-24 09:57:09.466714917 +0000 UTC m=+23.876201994" Jul 24 09:57:09.499416 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.499361 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8btcw" podStartSLOduration=4.455010886 podStartE2EDuration="23.499345433s" totalImagesPullingTime="19.044334547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:09.49910373 +0000 UTC m=+23.908590807" watchObservedRunningTime="2026-07-24 09:57:09.499345433 +0000 UTC m=+23.908832527" Jul 24 09:57:09.980347 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:09.980321 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 09:57:10.087688 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:10.087593 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T09:57:09.980340686Z","UUID":"e77c3270-b281-423d-a563-d8cc47812953","Handler":null,"Name":"","Endpoint":""} Jul 24 09:57:10.089028 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:10.089009 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 09:57:10.089136 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:10.089044 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 09:57:10.166951 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:10.166913 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:10.167132 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:10.166920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:10.167132 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:10.167033 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:10.167132 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:10.167086 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:10.167132 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:10.166921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:10.167414 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:10.167150 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:10.373201 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:10.373101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7zkzr" event={"ID":"55b645c3-4f1e-40cc-88ce-a2809ea86e0e","Type":"ContainerStarted","Data":"ee2088ebd820b5db25031e5513c58b67354d164cd2474eda78dc2e5da2a703c7"} Jul 24 09:57:10.374954 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:10.374924 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" event={"ID":"6951bb6d-4125-4b3d-b43b-8267b3cf78fd","Type":"ContainerStarted","Data":"75292f4a485db14a78a07568109bba5a701b84a63ca07374e52f3a2221e72f59"} Jul 24 09:57:10.390191 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:10.390147 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7zkzr" podStartSLOduration=5.338270928 podStartE2EDuration="24.390130838s" totalImagesPullingTime="19.05185991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:10.389928008 +0000 UTC m=+24.799415085" watchObservedRunningTime="2026-07-24 09:57:10.390130838 +0000 UTC m=+24.799617915" Jul 24 09:57:11.380116 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:11.379575 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" event={"ID":"6951bb6d-4125-4b3d-b43b-8267b3cf78fd","Type":"ContainerStarted","Data":"e60f8afc22a2ec35b1839e5d0ea9d45da03b2e09a8f43b328250f38332542795"} Jul 24 09:57:11.384988 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:11.384956 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" event={"ID":"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3","Type":"ContainerStarted","Data":"0ae6ac4316b74d9b44d4673b9427e293af64a25512251e9f188a97a680b68d59"} Jul 24 09:57:11.407411 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:11.407358 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wsr6" podStartSLOduration=2.898891519 podStartE2EDuration="24.407343688s" totalImagesPullingTime="21.508452169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:11.407093324 +0000 UTC m=+25.816580401" watchObservedRunningTime="2026-07-24 09:57:11.407343688 +0000 UTC m=+25.816830763" Jul 24 09:57:11.662159 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:11.662112 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:57:11.662757 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:11.662734 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:57:12.167470 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:12.167264 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:12.167644 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:12.167264 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:12.167644 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:12.167562 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:12.167644 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:12.167627 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:12.167644 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:12.167305 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:12.167846 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:12.167706 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:12.387536 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:12.387481 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:57:12.387944 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:12.387760 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4jj2v" Jul 24 09:57:14.167347 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:14.167310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:14.167947 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:14.167444 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:14.167947 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:14.167322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:14.167947 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:14.167548 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:14.167947 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:14.167322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:14.167947 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:14.167608 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:15.397719 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:15.397484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" event={"ID":"9b7e7e9c-823b-4a00-aae8-c66e1f513ca3","Type":"ContainerStarted","Data":"d799704fa57b98626c38d3a6c5575878f0331d8392cdd2d215998d54966d2584"} Jul 24 09:57:15.398496 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:15.397806 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:57:15.398496 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:15.397858 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:57:15.399530 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:15.399508 2563 generic.go:356] "Generic (PLEG): container finished" podID="d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a" containerID="c1289c9ba69a5dc2ddd7b8e0cfd00699eddadcfc49440483c8776d28deba092a" exitCode=0 Jul 24 09:57:15.399632 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:15.399536 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm74q" event={"ID":"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a","Type":"ContainerDied","Data":"c1289c9ba69a5dc2ddd7b8e0cfd00699eddadcfc49440483c8776d28deba092a"} Jul 24 09:57:15.414177 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:15.414155 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:57:15.428667 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:15.428625 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" podStartSLOduration=10.292413377 podStartE2EDuration="29.428610994s" totalImagesPullingTime="19.136197617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:15.427448524 +0000 UTC m=+29.836935600" watchObservedRunningTime="2026-07-24 09:57:15.428610994 +0000 UTC m=+29.838098071" Jul 24 09:57:16.168260 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.168213 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:16.168459 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.168337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:16.168459 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:16.168356 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:16.168575 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:16.168462 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:16.168575 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.168547 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:16.168670 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:16.168653 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:16.402012 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.401982 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:57:16.418080 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.418056 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:57:16.620077 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.620045 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xsj4t"] Jul 24 09:57:16.620283 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.620171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:16.620358 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:16.620296 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:16.623742 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.623713 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbz9f"] Jul 24 09:57:16.623859 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.623799 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:16.623909 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:16.623872 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:16.629260 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.629211 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ptzdc"] Jul 24 09:57:16.629396 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:16.629330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:16.629462 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:16.629432 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:17.405794 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:17.405767 2563 generic.go:356] "Generic (PLEG): container finished" podID="d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a" containerID="155a27a6eba114c66094639d4dd76549a7f7eb67c1838c74ad7f4037ed247af3" exitCode=0 Jul 24 09:57:17.406092 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:17.405854 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm74q" event={"ID":"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a","Type":"ContainerDied","Data":"155a27a6eba114c66094639d4dd76549a7f7eb67c1838c74ad7f4037ed247af3"} Jul 24 09:57:18.167122 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:18.167086 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:18.167280 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:18.167093 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:18.167280 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:18.167209 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:18.167377 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:18.167306 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:18.167377 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:18.167093 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:18.167449 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:18.167404 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:19.412009 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:19.411978 2563 generic.go:356] "Generic (PLEG): container finished" podID="d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a" containerID="78d0dfcb49c6b89ae317ea15901d1f1c43ea2630c1aca43ab6c3eefa1a0e04f8" exitCode=0 Jul 24 09:57:19.412473 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:19.412014 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm74q" event={"ID":"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a","Type":"ContainerDied","Data":"78d0dfcb49c6b89ae317ea15901d1f1c43ea2630c1aca43ab6c3eefa1a0e04f8"} Jul 24 09:57:19.886420 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:19.886375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:19.886590 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:19.886466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:19.886590 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:19.886557 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:57:19.886674 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:19.886633 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs podName:9eb06806-375e-4ad6-843e-2776aa98216c nodeName:}" failed. No retries permitted until 2026-07-24 09:57:51.886612252 +0000 UTC m=+66.296099321 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs") pod "network-metrics-daemon-ptzdc" (UID: "9eb06806-375e-4ad6-843e-2776aa98216c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:57:19.886674 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:19.886561 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:57:19.886755 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:19.886707 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret podName:d853ec2c-9dca-41db-b642-4ae5d6dc99c8 nodeName:}" failed. No retries permitted until 2026-07-24 09:57:51.886689279 +0000 UTC m=+66.296176350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret") pod "global-pull-secret-syncer-xsj4t" (UID: "d853ec2c-9dca-41db-b642-4ae5d6dc99c8") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:57:19.987481 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:19.987399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:19.987620 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:19.987565 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:57:19.987620 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:19.987583 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:57:19.987620 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:19.987593 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6z9d5 for pod openshift-network-diagnostics/network-check-target-mbz9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:57:19.987753 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:19.987644 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5 podName:4659c7c2-c649-4d08-ad8d-67c9b955c4ea nodeName:}" failed. No retries permitted until 2026-07-24 09:57:51.987631065 +0000 UTC m=+66.397118124 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6z9d5" (UniqueName: "kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5") pod "network-check-target-mbz9f" (UID: "4659c7c2-c649-4d08-ad8d-67c9b955c4ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:57:20.166723 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:20.166697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:20.166911 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:20.166697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:20.166911 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:20.166797 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbz9f" podUID="4659c7c2-c649-4d08-ad8d-67c9b955c4ea" Jul 24 09:57:20.166911 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:20.166705 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:20.166911 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:20.166888 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsj4t" podUID="d853ec2c-9dca-41db-b642-4ae5d6dc99c8" Jul 24 09:57:20.167087 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:20.167003 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ptzdc" podUID="9eb06806-375e-4ad6-843e-2776aa98216c" Jul 24 09:57:21.430329 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.430300 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-23.ec2.internal" event="NodeReady" Jul 24 09:57:21.431038 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.430439 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 09:57:21.512441 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.512392 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-747f64484c-w8zxh"] Jul 24 09:57:21.515514 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.515494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.520684 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.520430 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 09:57:21.520684 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.520452 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 09:57:21.520684 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.520586 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6cjdz\"" Jul 24 09:57:21.520684 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.520624 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 09:57:21.525998 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.525979 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 09:57:21.534217 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.534199 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vqjvn"] Jul 24 09:57:21.537043 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.537025 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.538783 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.538763 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m2h9d"] Jul 24 09:57:21.539979 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.539963 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xgf8p\"" Jul 24 09:57:21.540094 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.540079 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 09:57:21.540299 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.540284 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 09:57:21.541392 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.541379 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m2h9d" Jul 24 09:57:21.544629 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.544610 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 09:57:21.544629 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.544623 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 09:57:21.544927 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.544913 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lvdbw\"" Jul 24 09:57:21.546865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.546849 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 09:57:21.557810 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.557793 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-747f64484c-w8zxh"] Jul 24 09:57:21.558445 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.558422 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vqjvn"] Jul 24 09:57:21.559753 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.559736 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m2h9d"] Jul 24 09:57:21.700297 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700203 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b2c779c-2d51-4384-a584-5939c4e381bd-cert\") pod \"ingress-canary-m2h9d\" (UID: \"8b2c779c-2d51-4384-a584-5939c4e381bd\") " pod="openshift-ingress-canary/ingress-canary-m2h9d" Jul 24 09:57:21.700297 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.700495 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-bound-sa-token\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.700495 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-image-registry-private-configuration\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.700495 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-installation-pull-secrets\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.700495 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fdaaa75-19aa-4893-bfda-859e275d1e49-config-volume\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.700495 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.700495 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d234846d-5a02-4ac3-afef-576c1a05c8cd-ca-trust-extracted\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.700495 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qb5n\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-kube-api-access-9qb5n\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.700803 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-trusted-ca\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.700803 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fdaaa75-19aa-4893-bfda-859e275d1e49-tmp-dir\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.700803 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjnsb\" (UniqueName: \"kubernetes.io/projected/8b2c779c-2d51-4384-a584-5939c4e381bd-kube-api-access-zjnsb\") pod \"ingress-canary-m2h9d\" (UID: \"8b2c779c-2d51-4384-a584-5939c4e381bd\") " pod="openshift-ingress-canary/ingress-canary-m2h9d" Jul 24 09:57:21.700803 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-certificates\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.700803 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.700654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwvmw\" (UniqueName: \"kubernetes.io/projected/9fdaaa75-19aa-4893-bfda-859e275d1e49-kube-api-access-nwvmw\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.801501 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801473 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwvmw\" (UniqueName: \"kubernetes.io/projected/9fdaaa75-19aa-4893-bfda-859e275d1e49-kube-api-access-nwvmw\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.801663 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b2c779c-2d51-4384-a584-5939c4e381bd-cert\") pod \"ingress-canary-m2h9d\" (UID: \"8b2c779c-2d51-4384-a584-5939c4e381bd\") " pod="openshift-ingress-canary/ingress-canary-m2h9d" Jul 24 09:57:21.801663 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.801663 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-bound-sa-token\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.801663 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-image-registry-private-configuration\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.801663 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-installation-pull-secrets\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.801663 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fdaaa75-19aa-4893-bfda-859e275d1e49-config-volume\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.802056 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.802056 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801707 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d234846d-5a02-4ac3-afef-576c1a05c8cd-ca-trust-extracted\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.802056 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801733 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qb5n\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-kube-api-access-9qb5n\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.802056 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-trusted-ca\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.802056 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fdaaa75-19aa-4893-bfda-859e275d1e49-tmp-dir\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.802056 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjnsb\" (UniqueName: \"kubernetes.io/projected/8b2c779c-2d51-4384-a584-5939c4e381bd-kube-api-access-zjnsb\") pod \"ingress-canary-m2h9d\" (UID: \"8b2c779c-2d51-4384-a584-5939c4e381bd\") " pod="openshift-ingress-canary/ingress-canary-m2h9d" Jul 24 09:57:21.802056 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.801852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-certificates\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.802446 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.802422 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-certificates\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.802446 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.802438 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fdaaa75-19aa-4893-bfda-859e275d1e49-config-volume\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.802550 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:21.802524 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 09:57:21.802550 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:21.802539 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f64484c-w8zxh: secret "image-registry-tls" not found Jul 24 09:57:21.802647 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:21.802599 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls podName:d234846d-5a02-4ac3-afef-576c1a05c8cd nodeName:}" failed. No retries permitted until 2026-07-24 09:57:22.302581923 +0000 UTC m=+36.712068992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls") pod "image-registry-747f64484c-w8zxh" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd") : secret "image-registry-tls" not found Jul 24 09:57:21.803080 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.803052 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d234846d-5a02-4ac3-afef-576c1a05c8cd-ca-trust-extracted\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.803382 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.803337 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fdaaa75-19aa-4893-bfda-859e275d1e49-tmp-dir\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.803518 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:21.803492 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 09:57:21.803583 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:21.803571 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls podName:9fdaaa75-19aa-4893-bfda-859e275d1e49 nodeName:}" failed. No retries permitted until 2026-07-24 09:57:22.303549761 +0000 UTC m=+36.713036872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls") pod "dns-default-vqjvn" (UID: "9fdaaa75-19aa-4893-bfda-859e275d1e49") : secret "dns-default-metrics-tls" not found Jul 24 09:57:21.804483 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.804462 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-trusted-ca\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.807559 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.807536 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-installation-pull-secrets\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.807559 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.807554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b2c779c-2d51-4384-a584-5939c4e381bd-cert\") pod \"ingress-canary-m2h9d\" (UID: \"8b2c779c-2d51-4384-a584-5939c4e381bd\") " pod="openshift-ingress-canary/ingress-canary-m2h9d" Jul 24 09:57:21.808645 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.808622 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-image-registry-private-configuration\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.816384 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.816360 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-bound-sa-token\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.816727 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.816708 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjnsb\" (UniqueName: \"kubernetes.io/projected/8b2c779c-2d51-4384-a584-5939c4e381bd-kube-api-access-zjnsb\") pod \"ingress-canary-m2h9d\" (UID: \"8b2c779c-2d51-4384-a584-5939c4e381bd\") " pod="openshift-ingress-canary/ingress-canary-m2h9d" Jul 24 09:57:21.817991 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.817961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qb5n\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-kube-api-access-9qb5n\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:21.820923 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.820905 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwvmw\" (UniqueName: \"kubernetes.io/projected/9fdaaa75-19aa-4893-bfda-859e275d1e49-kube-api-access-nwvmw\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:21.851394 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:21.851370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m2h9d" Jul 24 09:57:22.011893 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.011657 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m2h9d"] Jul 24 09:57:22.166791 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.166753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:22.167010 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.166753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:22.167010 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.166753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:22.171099 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.171079 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5d4m8\"" Jul 24 09:57:22.171470 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.171453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 09:57:22.171761 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.171742 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6t48v\"" Jul 24 09:57:22.171853 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.171747 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 09:57:22.172059 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.171952 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 09:57:22.172162 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.172103 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 09:57:22.306163 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.306126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:22.306337 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:22.306242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:22.306337 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:22.306316 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 09:57:22.306467 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:22.306339 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f64484c-w8zxh: secret "image-registry-tls" not found Jul 24 09:57:22.306467 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:22.306375 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 09:57:22.306467 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:22.306434 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls podName:d234846d-5a02-4ac3-afef-576c1a05c8cd nodeName:}" failed. No retries permitted until 2026-07-24 09:57:23.30640427 +0000 UTC m=+37.715891341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls") pod "image-registry-747f64484c-w8zxh" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd") : secret "image-registry-tls" not found Jul 24 09:57:22.306467 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:22.306454 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls podName:9fdaaa75-19aa-4893-bfda-859e275d1e49 nodeName:}" failed. No retries permitted until 2026-07-24 09:57:23.306445183 +0000 UTC m=+37.715932239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls") pod "dns-default-vqjvn" (UID: "9fdaaa75-19aa-4893-bfda-859e275d1e49") : secret "dns-default-metrics-tls" not found Jul 24 09:57:23.315609 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:23.315574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:23.316161 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:23.315628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:23.316161 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:23.315756 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 09:57:23.316161 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:23.315772 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f64484c-w8zxh: secret "image-registry-tls" not found Jul 24 09:57:23.316161 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:23.315771 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 09:57:23.316161 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:23.315835 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls podName:d234846d-5a02-4ac3-afef-576c1a05c8cd nodeName:}" failed. No retries permitted until 2026-07-24 09:57:25.31581652 +0000 UTC m=+39.725303577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls") pod "image-registry-747f64484c-w8zxh" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd") : secret "image-registry-tls" not found Jul 24 09:57:23.316161 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:23.315882 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls podName:9fdaaa75-19aa-4893-bfda-859e275d1e49 nodeName:}" failed. No retries permitted until 2026-07-24 09:57:25.315864738 +0000 UTC m=+39.725351796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls") pod "dns-default-vqjvn" (UID: "9fdaaa75-19aa-4893-bfda-859e275d1e49") : secret "dns-default-metrics-tls" not found Jul 24 09:57:23.512430 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:57:23.512389 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2c779c_2d51_4384_a584_5939c4e381bd.slice/crio-ed09d50546c9045ed577be179fd0b05fc65f8786465d94320c2d5ec70b79a04c WatchSource:0}: Error finding container ed09d50546c9045ed577be179fd0b05fc65f8786465d94320c2d5ec70b79a04c: Status 404 returned error can't find the container with id ed09d50546c9045ed577be179fd0b05fc65f8786465d94320c2d5ec70b79a04c Jul 24 09:57:24.426098 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:24.426056 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m2h9d" event={"ID":"8b2c779c-2d51-4384-a584-5939c4e381bd","Type":"ContainerStarted","Data":"ed09d50546c9045ed577be179fd0b05fc65f8786465d94320c2d5ec70b79a04c"} Jul 24 09:57:24.429069 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:24.429039 2563 generic.go:356] "Generic (PLEG): container finished" podID="d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a" containerID="cd07707b8652e50555eeb75c072445777deed5f47c4e5ed4d7873895a70cf258" exitCode=0 Jul 24 09:57:24.429190 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:24.429078 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm74q" event={"ID":"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a","Type":"ContainerDied","Data":"cd07707b8652e50555eeb75c072445777deed5f47c4e5ed4d7873895a70cf258"} Jul 24 09:57:25.328906 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:25.328851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:25.329090 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:25.328911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:25.329090 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:25.329012 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 09:57:25.329090 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:25.329085 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls podName:9fdaaa75-19aa-4893-bfda-859e275d1e49 nodeName:}" failed. No retries permitted until 2026-07-24 09:57:29.329065198 +0000 UTC m=+43.738552259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls") pod "dns-default-vqjvn" (UID: "9fdaaa75-19aa-4893-bfda-859e275d1e49") : secret "dns-default-metrics-tls" not found Jul 24 09:57:25.329276 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:25.329088 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 09:57:25.329276 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:25.329107 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f64484c-w8zxh: secret "image-registry-tls" not found Jul 24 09:57:25.329276 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:25.329159 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls podName:d234846d-5a02-4ac3-afef-576c1a05c8cd nodeName:}" failed. No retries permitted until 2026-07-24 09:57:29.329142167 +0000 UTC m=+43.738629242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls") pod "image-registry-747f64484c-w8zxh" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd") : secret "image-registry-tls" not found Jul 24 09:57:25.434656 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:25.434622 2563 generic.go:356] "Generic (PLEG): container finished" podID="d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a" containerID="0b3616da9020557930eef0172d8b09a3a32cb056136414a3554687cdccf81030" exitCode=0 Jul 24 09:57:25.435019 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:25.434695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm74q" event={"ID":"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a","Type":"ContainerDied","Data":"0b3616da9020557930eef0172d8b09a3a32cb056136414a3554687cdccf81030"} Jul 24 09:57:26.437981 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:26.437743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m2h9d" event={"ID":"8b2c779c-2d51-4384-a584-5939c4e381bd","Type":"ContainerStarted","Data":"c092fd4e2e327b03e4134a3300e25dc9887a699a6957804c1bd22d1a05832c5d"} Jul 24 09:57:26.440830 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:26.440807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm74q" event={"ID":"d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a","Type":"ContainerStarted","Data":"19adf3e131ccda980f5d57ffb54080fd3064abcb8e5d626fa26ad05ce2e60a3e"} Jul 24 09:57:26.481011 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:26.480968 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m2h9d" podStartSLOduration=3.015936372 podStartE2EDuration="5.480954686s" totalImagesPullingTime="2.465018314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:26.480806818 +0000 UTC m=+40.890293894" watchObservedRunningTime="2026-07-24 09:57:26.480954686 +0000 UTC m=+40.890441763" Jul 24 09:57:26.523572 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:26.523534 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gm74q" podStartSLOduration=9.521179445 podStartE2EDuration="40.523519199s" totalImagesPullingTime="31.002339754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:26.521590495 +0000 UTC m=+40.931077572" watchObservedRunningTime="2026-07-24 09:57:26.523519199 +0000 UTC m=+40.933006253" Jul 24 09:57:29.360529 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:29.360492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:29.360904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:29.360619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:29.360904 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:29.360650 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 09:57:29.360904 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:29.360671 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f64484c-w8zxh: secret "image-registry-tls" not found Jul 24 09:57:29.360904 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:29.360700 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 09:57:29.360904 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:29.360736 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls podName:d234846d-5a02-4ac3-afef-576c1a05c8cd nodeName:}" failed. No retries permitted until 2026-07-24 09:57:37.360717467 +0000 UTC m=+51.770204535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls") pod "image-registry-747f64484c-w8zxh" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd") : secret "image-registry-tls" not found Jul 24 09:57:29.360904 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:29.360760 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls podName:9fdaaa75-19aa-4893-bfda-859e275d1e49 nodeName:}" failed. No retries permitted until 2026-07-24 09:57:37.360748953 +0000 UTC m=+51.770236011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls") pod "dns-default-vqjvn" (UID: "9fdaaa75-19aa-4893-bfda-859e275d1e49") : secret "dns-default-metrics-tls" not found Jul 24 09:57:37.414066 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:37.414026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:37.414066 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:37.414068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:37.414729 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:37.414174 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 09:57:37.414729 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:37.414184 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f64484c-w8zxh: secret "image-registry-tls" not found Jul 24 09:57:37.414729 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:37.414185 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 09:57:37.414729 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:37.414268 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls podName:d234846d-5a02-4ac3-afef-576c1a05c8cd nodeName:}" failed. No retries permitted until 2026-07-24 09:57:53.414249647 +0000 UTC m=+67.823736717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls") pod "image-registry-747f64484c-w8zxh" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd") : secret "image-registry-tls" not found Jul 24 09:57:37.414729 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:37.414282 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls podName:9fdaaa75-19aa-4893-bfda-859e275d1e49 nodeName:}" failed. No retries permitted until 2026-07-24 09:57:53.414276165 +0000 UTC m=+67.823763220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls") pod "dns-default-vqjvn" (UID: "9fdaaa75-19aa-4893-bfda-859e275d1e49") : secret "dns-default-metrics-tls" not found Jul 24 09:57:48.418636 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:48.418608 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8zhm" Jul 24 09:57:51.920526 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:51.920475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:51.920526 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:51.920531 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:57:51.922594 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:51.922570 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 09:57:51.922684 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:51.922670 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 09:57:51.931480 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:51.931463 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 24 09:57:51.931560 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:51.931550 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs podName:9eb06806-375e-4ad6-843e-2776aa98216c nodeName:}" failed. No retries permitted until 2026-07-24 09:58:55.931529524 +0000 UTC m=+130.341016579 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs") pod "network-metrics-daemon-ptzdc" (UID: "9eb06806-375e-4ad6-843e-2776aa98216c") : secret "metrics-daemon-secret" not found Jul 24 09:57:51.935150 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:51.935130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d853ec2c-9dca-41db-b642-4ae5d6dc99c8-original-pull-secret\") pod \"global-pull-secret-syncer-xsj4t\" (UID: \"d853ec2c-9dca-41db-b642-4ae5d6dc99c8\") " pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:52.021599 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.021550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:52.024069 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.024049 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 09:57:52.034485 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.034466 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 09:57:52.045010 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.044988 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z9d5\" (UniqueName: \"kubernetes.io/projected/4659c7c2-c649-4d08-ad8d-67c9b955c4ea-kube-api-access-6z9d5\") pod \"network-check-target-mbz9f\" (UID: \"4659c7c2-c649-4d08-ad8d-67c9b955c4ea\") " pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:52.187243 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.187152 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsj4t" Jul 24 09:57:52.196192 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.196170 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6t48v\"" Jul 24 09:57:52.204148 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.204126 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:52.323003 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.322972 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xsj4t"] Jul 24 09:57:52.327692 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:57:52.327670 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd853ec2c_9dca_41db_b642_4ae5d6dc99c8.slice/crio-7700323d7c89ab5e3279b641af27bb6bf434baa0409cb8539bb53fee02df1268 WatchSource:0}: Error finding container 7700323d7c89ab5e3279b641af27bb6bf434baa0409cb8539bb53fee02df1268: Status 404 returned error can't find the container with id 7700323d7c89ab5e3279b641af27bb6bf434baa0409cb8539bb53fee02df1268 Jul 24 09:57:52.335898 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.335872 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbz9f"] Jul 24 09:57:52.338597 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:57:52.338577 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4659c7c2_c649_4d08_ad8d_67c9b955c4ea.slice/crio-13364dab9730850ed330ae45460526649f455e3fe919ee1894c068d51cbb3740 WatchSource:0}: Error finding container 13364dab9730850ed330ae45460526649f455e3fe919ee1894c068d51cbb3740: Status 404 returned error can't find the container with id 13364dab9730850ed330ae45460526649f455e3fe919ee1894c068d51cbb3740 Jul 24 09:57:52.498594 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.498505 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbz9f" event={"ID":"4659c7c2-c649-4d08-ad8d-67c9b955c4ea","Type":"ContainerStarted","Data":"13364dab9730850ed330ae45460526649f455e3fe919ee1894c068d51cbb3740"} Jul 24 09:57:52.499523 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:52.499502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xsj4t" event={"ID":"d853ec2c-9dca-41db-b642-4ae5d6dc99c8","Type":"ContainerStarted","Data":"7700323d7c89ab5e3279b641af27bb6bf434baa0409cb8539bb53fee02df1268"} Jul 24 09:57:53.432388 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:53.432354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:57:53.432388 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:53.432397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:57:53.440502 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:53.440372 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 09:57:53.440502 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:53.440401 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f64484c-w8zxh: secret "image-registry-tls" not found Jul 24 09:57:53.440502 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:53.440405 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 09:57:53.440502 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:53.440498 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls podName:d234846d-5a02-4ac3-afef-576c1a05c8cd nodeName:}" failed. No retries permitted until 2026-07-24 09:58:25.440468134 +0000 UTC m=+99.849955206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls") pod "image-registry-747f64484c-w8zxh" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd") : secret "image-registry-tls" not found Jul 24 09:57:53.440794 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:57:53.440519 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls podName:9fdaaa75-19aa-4893-bfda-859e275d1e49 nodeName:}" failed. No retries permitted until 2026-07-24 09:58:25.440508158 +0000 UTC m=+99.849995220 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls") pod "dns-default-vqjvn" (UID: "9fdaaa75-19aa-4893-bfda-859e275d1e49") : secret "dns-default-metrics-tls" not found Jul 24 09:57:57.513501 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:57.513465 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbz9f" event={"ID":"4659c7c2-c649-4d08-ad8d-67c9b955c4ea","Type":"ContainerStarted","Data":"5f2cac0b87fe1a745a4c857b1f3986ed611290b7fa474e6a14f99d312d40c2fd"} Jul 24 09:57:57.513932 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:57.513548 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:57:57.514890 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:57.514869 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xsj4t" event={"ID":"d853ec2c-9dca-41db-b642-4ae5d6dc99c8","Type":"ContainerStarted","Data":"472ae29fb4acf6f0dd941883647499cd083a5bb1fb5f5738ef79fd471d9d9d6e"} Jul 24 09:57:57.536249 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:57.536159 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mbz9f" podStartSLOduration=66.029412773 podStartE2EDuration="1m10.536139742s" totalImagesPullingTime="4.506726969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:57.534775252 +0000 UTC m=+71.944262332" watchObservedRunningTime="2026-07-24 09:57:57.536139742 +0000 UTC m=+71.945626820" Jul 24 09:57:57.551784 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:57:57.551743 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xsj4t" podStartSLOduration=66.030241281 podStartE2EDuration="1m10.551730163s" totalImagesPullingTime="4.521488882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:57:57.550888 +0000 UTC m=+71.960375079" watchObservedRunningTime="2026-07-24 09:57:57.551730163 +0000 UTC m=+71.961217239" Jul 24 09:58:16.807867 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.807745 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6f5tr"] Jul 24 09:58:16.811951 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.811935 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:16.820317 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.820297 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 09:58:16.820423 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.820408 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 09:58:16.821068 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.821056 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 09:58:16.821102 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.821074 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lt8v2\"" Jul 24 09:58:16.821139 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.821058 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 09:58:16.855200 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.855177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6f5tr"] Jul 24 09:58:16.901825 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.901796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgnjt\" (UniqueName: \"kubernetes.io/projected/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-api-access-xgnjt\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:16.901974 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.901834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-data-volume\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:16.901974 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.901854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:16.901974 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.901911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-crio-socket\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:16.901974 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:16.901950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.002286 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.002253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgnjt\" (UniqueName: \"kubernetes.io/projected/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-api-access-xgnjt\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.002467 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.002299 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-data-volume\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.002467 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.002317 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.002467 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.002343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-crio-socket\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.002467 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.002391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.002467 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:17.002428 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 09:58:17.002690 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.002491 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-crio-socket\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.002690 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:17.002515 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:17.50249299 +0000 UTC m=+91.911980063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : secret "insights-runtime-extractor-tls" not found Jul 24 09:58:17.002690 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:17.002527 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 09:58:17.002690 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:17.002572 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:17.502561467 +0000 UTC m=+91.912048544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : configmap "kube-rbac-proxy" not found Jul 24 09:58:17.002690 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.002676 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-data-volume\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.012803 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.012775 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgnjt\" (UniqueName: \"kubernetes.io/projected/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-api-access-xgnjt\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.505605 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.505562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.505799 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:17.505614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:17.505799 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:17.505700 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 09:58:17.505799 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:17.505715 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 09:58:17.505799 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:17.505774 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:18.505758317 +0000 UTC m=+92.915245373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : secret "insights-runtime-extractor-tls" not found Jul 24 09:58:17.505799 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:17.505788 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:18.505781336 +0000 UTC m=+92.915268391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : configmap "kube-rbac-proxy" not found Jul 24 09:58:18.512433 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:18.512392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:18.512890 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:18.512490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:18.512890 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:18.512538 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 09:58:18.512890 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:18.512587 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 09:58:18.512890 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:18.512639 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:20.512618351 +0000 UTC m=+94.922105421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : configmap "kube-rbac-proxy" not found Jul 24 09:58:18.512890 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:18.512659 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:20.512650145 +0000 UTC m=+94.922137206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : secret "insights-runtime-extractor-tls" not found Jul 24 09:58:18.780521 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:18.780435 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hw722_51252953-771c-415b-ac0c-aeda706ffb9c/dns-node-resolver/0.log" Jul 24 09:58:19.580975 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:19.580946 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mltsd_7d9e1c55-0d7c-472d-a280-a625f562517c/node-ca/0.log" Jul 24 09:58:20.180366 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:20.180334 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m2h9d_8b2c779c-2d51-4384-a584-5939c4e381bd/serve-healthcheck-canary/0.log" Jul 24 09:58:20.527918 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:20.527831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:20.527918 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:20.527908 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:20.528096 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:20.527962 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 09:58:20.528096 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:20.527998 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 09:58:20.528096 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:20.528027 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:24.528011199 +0000 UTC m=+98.937498256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : configmap "kube-rbac-proxy" not found Jul 24 09:58:20.528096 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:20.528042 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:24.528035563 +0000 UTC m=+98.937522621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : secret "insights-runtime-extractor-tls" not found Jul 24 09:58:24.556306 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:24.556251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:24.556306 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:24.556312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:24.556846 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:24.556379 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 09:58:24.556846 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:24.556419 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 09:58:24.556846 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:24.556449 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:32.55643087 +0000 UTC m=+106.965917925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : configmap "kube-rbac-proxy" not found Jul 24 09:58:24.556846 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:24.556485 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:32.556465194 +0000 UTC m=+106.965952252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : secret "insights-runtime-extractor-tls" not found Jul 24 09:58:25.460505 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:25.460470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:58:25.460505 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:25.460509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") pod \"image-registry-747f64484c-w8zxh\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:58:25.460695 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:25.460604 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 09:58:25.460695 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:25.460608 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 09:58:25.460695 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:25.460616 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f64484c-w8zxh: secret "image-registry-tls" not found Jul 24 09:58:25.460695 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:25.460667 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls podName:9fdaaa75-19aa-4893-bfda-859e275d1e49 nodeName:}" failed. No retries permitted until 2026-07-24 09:59:29.460652804 +0000 UTC m=+163.870139859 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls") pod "dns-default-vqjvn" (UID: "9fdaaa75-19aa-4893-bfda-859e275d1e49") : secret "dns-default-metrics-tls" not found Jul 24 09:58:25.460695 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:25.460680 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls podName:d234846d-5a02-4ac3-afef-576c1a05c8cd nodeName:}" failed. No retries permitted until 2026-07-24 09:59:29.460674426 +0000 UTC m=+163.870161481 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls") pod "image-registry-747f64484c-w8zxh" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd") : secret "image-registry-tls" not found Jul 24 09:58:26.344292 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.344255 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp"] Jul 24 09:58:26.349377 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.349361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp" Jul 24 09:58:26.351538 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.351517 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s89w8\"" Jul 24 09:58:26.352324 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.352308 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 09:58:26.352384 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.352308 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 09:58:26.356906 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.356888 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp"] Jul 24 09:58:26.468885 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.468801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z98z5\" (UniqueName: \"kubernetes.io/projected/26c8dc3f-43de-48f5-bed7-07bed31e9b0e-kube-api-access-z98z5\") pod \"migrator-6865c9967-mklcp\" (UID: \"26c8dc3f-43de-48f5-bed7-07bed31e9b0e\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp" Jul 24 09:58:26.569800 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.569763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z98z5\" (UniqueName: \"kubernetes.io/projected/26c8dc3f-43de-48f5-bed7-07bed31e9b0e-kube-api-access-z98z5\") pod \"migrator-6865c9967-mklcp\" (UID: \"26c8dc3f-43de-48f5-bed7-07bed31e9b0e\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp" Jul 24 09:58:26.578363 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.578340 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z98z5\" (UniqueName: \"kubernetes.io/projected/26c8dc3f-43de-48f5-bed7-07bed31e9b0e-kube-api-access-z98z5\") pod \"migrator-6865c9967-mklcp\" (UID: \"26c8dc3f-43de-48f5-bed7-07bed31e9b0e\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp" Jul 24 09:58:26.658430 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.658394 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp" Jul 24 09:58:26.796067 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:26.796034 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp"] Jul 24 09:58:26.799410 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:58:26.799381 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c8dc3f_43de_48f5_bed7_07bed31e9b0e.slice/crio-eb03fadc4c669523a6eaaf11e8dea39e176ce9b4dcd04ffa605beef9dc1cd5b4 WatchSource:0}: Error finding container eb03fadc4c669523a6eaaf11e8dea39e176ce9b4dcd04ffa605beef9dc1cd5b4: Status 404 returned error can't find the container with id eb03fadc4c669523a6eaaf11e8dea39e176ce9b4dcd04ffa605beef9dc1cd5b4 Jul 24 09:58:27.588072 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:27.588035 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp" event={"ID":"26c8dc3f-43de-48f5-bed7-07bed31e9b0e","Type":"ContainerStarted","Data":"eb03fadc4c669523a6eaaf11e8dea39e176ce9b4dcd04ffa605beef9dc1cd5b4"} Jul 24 09:58:28.519811 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:28.519790 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mbz9f" Jul 24 09:58:28.592837 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:28.592808 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp" event={"ID":"26c8dc3f-43de-48f5-bed7-07bed31e9b0e","Type":"ContainerStarted","Data":"7742d1c47c4efb932ed766ffd394690036c53b106e2e02554150ff560f9fc828"} Jul 24 09:58:28.593151 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:28.592871 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp" event={"ID":"26c8dc3f-43de-48f5-bed7-07bed31e9b0e","Type":"ContainerStarted","Data":"7054d030cbdbaf941f0369b6830131b86bcf3567e61527aa033949c0afc6bb7d"} Jul 24 09:58:29.626853 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:29.626805 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mklcp" podStartSLOduration=2.059308473 podStartE2EDuration="3.62678912s" totalImagesPullingTime="1.567480647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:58:29.625279417 +0000 UTC m=+104.034766504" watchObservedRunningTime="2026-07-24 09:58:29.62678912 +0000 UTC m=+104.036276196" Jul 24 09:58:32.615645 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:32.615614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:32.616051 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:32.615654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:32.616051 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:32.615770 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 09:58:32.616051 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:58:32.615842 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls podName:9c735757-85e4-4a1c-a3d5-e7506a1dae4b nodeName:}" failed. No retries permitted until 2026-07-24 09:58:48.615823241 +0000 UTC m=+123.025310300 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5tr" (UID: "9c735757-85e4-4a1c-a3d5-e7506a1dae4b") : secret "insights-runtime-extractor-tls" not found Jul 24 09:58:32.616288 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:32.616271 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:33.146118 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.146087 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-t27d7"] Jul 24 09:58:33.148610 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.148596 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.155710 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.155684 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 24 09:58:33.155817 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.155730 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 24 09:58:33.155877 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.155850 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8h72z\"" Jul 24 09:58:33.156597 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.156580 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 24 09:58:33.157459 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.157446 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 24 09:58:33.165667 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.165649 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-t27d7"] Jul 24 09:58:33.321494 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.321455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sfh9\" (UniqueName: \"kubernetes.io/projected/514f2660-2855-4f65-b0ae-661f7613dce5-kube-api-access-6sfh9\") pod \"service-ca-658d7b7c78-t27d7\" (UID: \"514f2660-2855-4f65-b0ae-661f7613dce5\") " pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.321682 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.321521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/514f2660-2855-4f65-b0ae-661f7613dce5-signing-cabundle\") pod \"service-ca-658d7b7c78-t27d7\" (UID: \"514f2660-2855-4f65-b0ae-661f7613dce5\") " pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.321682 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.321552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/514f2660-2855-4f65-b0ae-661f7613dce5-signing-key\") pod \"service-ca-658d7b7c78-t27d7\" (UID: \"514f2660-2855-4f65-b0ae-661f7613dce5\") " pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.422330 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.422251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/514f2660-2855-4f65-b0ae-661f7613dce5-signing-cabundle\") pod \"service-ca-658d7b7c78-t27d7\" (UID: \"514f2660-2855-4f65-b0ae-661f7613dce5\") " pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.422330 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.422292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/514f2660-2855-4f65-b0ae-661f7613dce5-signing-key\") pod \"service-ca-658d7b7c78-t27d7\" (UID: \"514f2660-2855-4f65-b0ae-661f7613dce5\") " pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.422498 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.422475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sfh9\" (UniqueName: \"kubernetes.io/projected/514f2660-2855-4f65-b0ae-661f7613dce5-kube-api-access-6sfh9\") pod \"service-ca-658d7b7c78-t27d7\" (UID: \"514f2660-2855-4f65-b0ae-661f7613dce5\") " pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.423092 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.423018 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/514f2660-2855-4f65-b0ae-661f7613dce5-signing-cabundle\") pod \"service-ca-658d7b7c78-t27d7\" (UID: \"514f2660-2855-4f65-b0ae-661f7613dce5\") " pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.424840 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.424815 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/514f2660-2855-4f65-b0ae-661f7613dce5-signing-key\") pod \"service-ca-658d7b7c78-t27d7\" (UID: \"514f2660-2855-4f65-b0ae-661f7613dce5\") " pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.431612 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.431589 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sfh9\" (UniqueName: \"kubernetes.io/projected/514f2660-2855-4f65-b0ae-661f7613dce5-kube-api-access-6sfh9\") pod \"service-ca-658d7b7c78-t27d7\" (UID: \"514f2660-2855-4f65-b0ae-661f7613dce5\") " pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.457510 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.457491 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" Jul 24 09:58:33.594621 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.594591 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-t27d7"] Jul 24 09:58:33.597768 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:58:33.597738 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514f2660_2855_4f65_b0ae_661f7613dce5.slice/crio-e59c1b1b5baa928d8fe453b0b7ec913e28426ff028e1965fe3638c1793ae4fd5 WatchSource:0}: Error finding container e59c1b1b5baa928d8fe453b0b7ec913e28426ff028e1965fe3638c1793ae4fd5: Status 404 returned error can't find the container with id e59c1b1b5baa928d8fe453b0b7ec913e28426ff028e1965fe3638c1793ae4fd5 Jul 24 09:58:33.605838 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:33.605818 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" event={"ID":"514f2660-2855-4f65-b0ae-661f7613dce5","Type":"ContainerStarted","Data":"e59c1b1b5baa928d8fe453b0b7ec913e28426ff028e1965fe3638c1793ae4fd5"} Jul 24 09:58:35.616552 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:35.616516 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" event={"ID":"514f2660-2855-4f65-b0ae-661f7613dce5","Type":"ContainerStarted","Data":"c4395594a84a06e052177cb932da2c456d02b4561f4f88a20e484b6bd9a47bba"} Jul 24 09:58:35.636629 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:35.636579 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-t27d7" podStartSLOduration=0.785226724 podStartE2EDuration="2.636561971s" totalImagesPullingTime="1.851335247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:58:35.636332685 +0000 UTC m=+110.045819762" watchObservedRunningTime="2026-07-24 09:58:35.636561971 +0000 UTC m=+110.046049053" Jul 24 09:58:48.638765 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:48.638732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:48.641124 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:48.641093 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c735757-85e4-4a1c-a3d5-e7506a1dae4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5tr\" (UID: \"9c735757-85e4-4a1c-a3d5-e7506a1dae4b\") " pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:48.922149 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:48.922071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lt8v2\"" Jul 24 09:58:48.930078 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:48.930048 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6f5tr" Jul 24 09:58:49.063468 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:49.063425 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6f5tr"] Jul 24 09:58:49.067606 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:58:49.067583 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c735757_85e4_4a1c_a3d5_e7506a1dae4b.slice/crio-4e094f8b2e0523e7a3586be1c1f99231d6e98bb196a424cb77c8a58183be185b WatchSource:0}: Error finding container 4e094f8b2e0523e7a3586be1c1f99231d6e98bb196a424cb77c8a58183be185b: Status 404 returned error can't find the container with id 4e094f8b2e0523e7a3586be1c1f99231d6e98bb196a424cb77c8a58183be185b Jul 24 09:58:49.658564 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:49.658525 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6f5tr" event={"ID":"9c735757-85e4-4a1c-a3d5-e7506a1dae4b","Type":"ContainerStarted","Data":"4e094f8b2e0523e7a3586be1c1f99231d6e98bb196a424cb77c8a58183be185b"} Jul 24 09:58:53.728826 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.728792 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f"] Jul 24 09:58:53.732082 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.732063 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" Jul 24 09:58:53.735747 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.735396 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 09:58:53.735747 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.735617 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6kqdd\"" Jul 24 09:58:53.735747 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.735649 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 09:58:53.736969 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.736949 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 24 09:58:53.737085 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.737015 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 09:58:53.753592 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.753565 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f"] Jul 24 09:58:53.781447 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.781417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53a3e872-41fc-4059-9abe-83ceca6d0851-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79bd58b456-8mq6f\" (UID: \"53a3e872-41fc-4059-9abe-83ceca6d0851\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" Jul 24 09:58:53.781565 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.781485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k5w2\" (UniqueName: \"kubernetes.io/projected/53a3e872-41fc-4059-9abe-83ceca6d0851-kube-api-access-8k5w2\") pod \"managed-serviceaccount-addon-agent-79bd58b456-8mq6f\" (UID: \"53a3e872-41fc-4059-9abe-83ceca6d0851\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" Jul 24 09:58:53.837978 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.837941 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dc6867bc4-rtl8p"] Jul 24 09:58:53.841254 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.841200 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.844436 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.844151 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 09:58:53.844436 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.844171 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 09:58:53.844436 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.844202 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 09:58:53.844648 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.844516 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 09:58:53.847135 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.847115 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 09:58:53.847260 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.847186 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gtrxr\"" Jul 24 09:58:53.847260 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.847197 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 09:58:53.847597 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.847578 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 09:58:53.856923 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.856895 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dc6867bc4-rtl8p"] Jul 24 09:58:53.881905 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.881866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj4cp\" (UniqueName: \"kubernetes.io/projected/fddd1d45-7519-46f9-adc5-cec86be6c470-kube-api-access-cj4cp\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.882067 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.882020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-service-ca\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.882067 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.882055 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53a3e872-41fc-4059-9abe-83ceca6d0851-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79bd58b456-8mq6f\" (UID: \"53a3e872-41fc-4059-9abe-83ceca6d0851\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" Jul 24 09:58:53.882166 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.882128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-serving-cert\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.882166 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.882153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-oauth-serving-cert\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.882867 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.882176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-oauth-config\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.882867 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.882201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-console-config\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.882867 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.882305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k5w2\" (UniqueName: \"kubernetes.io/projected/53a3e872-41fc-4059-9abe-83ceca6d0851-kube-api-access-8k5w2\") pod \"managed-serviceaccount-addon-agent-79bd58b456-8mq6f\" (UID: \"53a3e872-41fc-4059-9abe-83ceca6d0851\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" Jul 24 09:58:53.885383 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.885364 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53a3e872-41fc-4059-9abe-83ceca6d0851-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79bd58b456-8mq6f\" (UID: \"53a3e872-41fc-4059-9abe-83ceca6d0851\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" Jul 24 09:58:53.903569 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.903540 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k5w2\" (UniqueName: \"kubernetes.io/projected/53a3e872-41fc-4059-9abe-83ceca6d0851-kube-api-access-8k5w2\") pod \"managed-serviceaccount-addon-agent-79bd58b456-8mq6f\" (UID: \"53a3e872-41fc-4059-9abe-83ceca6d0851\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" Jul 24 09:58:53.983034 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.983004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj4cp\" (UniqueName: \"kubernetes.io/projected/fddd1d45-7519-46f9-adc5-cec86be6c470-kube-api-access-cj4cp\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.983137 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.983121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-service-ca\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.983176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.983154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-serving-cert\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.983214 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.983175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-oauth-serving-cert\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.983214 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.983200 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-oauth-config\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.983342 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.983223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-console-config\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.983912 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.983888 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-service-ca\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.984013 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.983926 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-console-config\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.984013 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.983946 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-oauth-serving-cert\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.985833 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.985816 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-oauth-config\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.986248 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.986215 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-serving-cert\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:53.997601 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:53.997577 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj4cp\" (UniqueName: \"kubernetes.io/projected/fddd1d45-7519-46f9-adc5-cec86be6c470-kube-api-access-cj4cp\") pod \"console-5dc6867bc4-rtl8p\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:54.056475 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:54.056446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" Jul 24 09:58:54.152475 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:54.152449 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:58:54.191904 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:54.191871 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f"] Jul 24 09:58:54.194538 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:58:54.194505 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53a3e872_41fc_4059_9abe_83ceca6d0851.slice/crio-a9a0c7f6659bd50fdd8927a7d59b2c96f7c35d055852957fd8b7f61ae5b94b00 WatchSource:0}: Error finding container a9a0c7f6659bd50fdd8927a7d59b2c96f7c35d055852957fd8b7f61ae5b94b00: Status 404 returned error can't find the container with id a9a0c7f6659bd50fdd8927a7d59b2c96f7c35d055852957fd8b7f61ae5b94b00 Jul 24 09:58:54.277668 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:54.277604 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dc6867bc4-rtl8p"] Jul 24 09:58:54.280452 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:58:54.280430 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfddd1d45_7519_46f9_adc5_cec86be6c470.slice/crio-0909f69758f6a953f094389a925ad157ce8df8010f651027c32b862970f08e2d WatchSource:0}: Error finding container 0909f69758f6a953f094389a925ad157ce8df8010f651027c32b862970f08e2d: Status 404 returned error can't find the container with id 0909f69758f6a953f094389a925ad157ce8df8010f651027c32b862970f08e2d Jul 24 09:58:54.677871 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:54.677783 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc6867bc4-rtl8p" event={"ID":"fddd1d45-7519-46f9-adc5-cec86be6c470","Type":"ContainerStarted","Data":"0909f69758f6a953f094389a925ad157ce8df8010f651027c32b862970f08e2d"} Jul 24 09:58:54.680825 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:54.680761 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" event={"ID":"53a3e872-41fc-4059-9abe-83ceca6d0851","Type":"ContainerStarted","Data":"a9a0c7f6659bd50fdd8927a7d59b2c96f7c35d055852957fd8b7f61ae5b94b00"} Jul 24 09:58:54.683548 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:54.683441 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6f5tr" event={"ID":"9c735757-85e4-4a1c-a3d5-e7506a1dae4b","Type":"ContainerStarted","Data":"816d3ac6f558e72cfea5a23e8ed16e73cbe1b92027b56a293de0c16e8f98f29f"} Jul 24 09:58:55.999865 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:55.999539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:58:56.003015 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:56.002987 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb06806-375e-4ad6-843e-2776aa98216c-metrics-certs\") pod \"network-metrics-daemon-ptzdc\" (UID: \"9eb06806-375e-4ad6-843e-2776aa98216c\") " pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:58:56.081895 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:56.081703 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5d4m8\"" Jul 24 09:58:56.089895 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:58:56.089873 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ptzdc" Jul 24 09:59:00.311483 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:00.311453 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ptzdc"] Jul 24 09:59:00.314043 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:00.314015 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb06806_375e_4ad6_843e_2776aa98216c.slice/crio-b1e0c322666061b79fcfa667920a70bd05bf35f95d5b36a93c612f715fa4dd4d WatchSource:0}: Error finding container b1e0c322666061b79fcfa667920a70bd05bf35f95d5b36a93c612f715fa4dd4d: Status 404 returned error can't find the container with id b1e0c322666061b79fcfa667920a70bd05bf35f95d5b36a93c612f715fa4dd4d Jul 24 09:59:00.708584 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:00.708547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6f5tr" event={"ID":"9c735757-85e4-4a1c-a3d5-e7506a1dae4b","Type":"ContainerStarted","Data":"455c04268b6514c370f22373d66f7eb841350011376b6698a2a29ea0f88fd431"} Jul 24 09:59:00.709874 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:00.709850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc6867bc4-rtl8p" event={"ID":"fddd1d45-7519-46f9-adc5-cec86be6c470","Type":"ContainerStarted","Data":"e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9"} Jul 24 09:59:00.710907 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:00.710880 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ptzdc" event={"ID":"9eb06806-375e-4ad6-843e-2776aa98216c","Type":"ContainerStarted","Data":"b1e0c322666061b79fcfa667920a70bd05bf35f95d5b36a93c612f715fa4dd4d"} Jul 24 09:59:00.711992 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:00.711970 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" event={"ID":"53a3e872-41fc-4059-9abe-83ceca6d0851","Type":"ContainerStarted","Data":"387a9b1064def36c9bc24842221fe9c5b83fe91ce29ef572b68a8e96c32a3f03"} Jul 24 09:59:00.740826 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:00.740755 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dc6867bc4-rtl8p" podStartSLOduration=1.8585105469999998 podStartE2EDuration="7.740735647s" totalImagesPullingTime="5.8822251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:00.739749523 +0000 UTC m=+135.149236601" watchObservedRunningTime="2026-07-24 09:59:00.740735647 +0000 UTC m=+135.150222725" Jul 24 09:59:00.762338 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:00.762183 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79bd58b456-8mq6f" podStartSLOduration=1.795845044 podStartE2EDuration="7.762171518s" totalImagesPullingTime="5.966326474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:00.760518972 +0000 UTC m=+135.170006051" watchObservedRunningTime="2026-07-24 09:59:00.762171518 +0000 UTC m=+135.171658573" Jul 24 09:59:01.717436 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:01.717349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ptzdc" event={"ID":"9eb06806-375e-4ad6-843e-2776aa98216c","Type":"ContainerStarted","Data":"e5d7e7eede48a63001d5f076be35717b3529545117b13f2f5928bdd67e7a03e1"} Jul 24 09:59:01.717436 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:01.717414 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ptzdc" event={"ID":"9eb06806-375e-4ad6-843e-2776aa98216c","Type":"ContainerStarted","Data":"6532602ac7de1784b236c7621dad1cdc707a2cad0a6a44625b24327ffc2c3b33"} Jul 24 09:59:01.741756 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:01.741703 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ptzdc" podStartSLOduration=134.752098755 podStartE2EDuration="2m15.741679356s" totalImagesPullingTime="989.580601ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:01.741681198 +0000 UTC m=+136.151168276" watchObservedRunningTime="2026-07-24 09:59:01.741679356 +0000 UTC m=+136.151166437" Jul 24 09:59:03.791466 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.791430 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v8sms"] Jul 24 09:59:03.802591 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.802554 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.805257 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.805216 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 09:59:03.808993 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.808965 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v8sms"] Jul 24 09:59:03.813081 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.813018 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 09:59:03.813899 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.813877 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 09:59:03.813986 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.813924 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 09:59:03.814024 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.813982 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 09:59:03.814166 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.814148 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-q98wv\"" Jul 24 09:59:03.866710 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.866675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.866806 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.866740 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.866848 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.866812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.866886 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.866851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5gk5\" (UniqueName: \"kubernetes.io/projected/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-kube-api-access-g5gk5\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.967438 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.967394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5gk5\" (UniqueName: \"kubernetes.io/projected/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-kube-api-access-g5gk5\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.967642 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.967447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.967642 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.967505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.967642 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.967556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.967642 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:59:03.967614 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 24 09:59:03.967834 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:59:03.967740 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-prometheus-operator-tls podName:183b25df-3a2f-4b7a-97e5-aadbb5089e7c nodeName:}" failed. No retries permitted until 2026-07-24 09:59:04.467720611 +0000 UTC m=+138.877207666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-v8sms" (UID: "183b25df-3a2f-4b7a-97e5-aadbb5089e7c") : secret "prometheus-operator-tls" not found Jul 24 09:59:03.968250 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.968215 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.970165 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.970144 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:03.982753 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:03.982733 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5gk5\" (UniqueName: \"kubernetes.io/projected/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-kube-api-access-g5gk5\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:04.153346 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.153309 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:59:04.153525 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.153379 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:59:04.158092 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.158070 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:59:04.471526 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.471438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:04.473897 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.473871 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/183b25df-3a2f-4b7a-97e5-aadbb5089e7c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v8sms\" (UID: \"183b25df-3a2f-4b7a-97e5-aadbb5089e7c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:04.714082 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.714054 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" Jul 24 09:59:04.730481 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.730445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6f5tr" event={"ID":"9c735757-85e4-4a1c-a3d5-e7506a1dae4b","Type":"ContainerStarted","Data":"fa4745fc2fa99b31d09dea3ed85243828ec03bbd2c85a22236f231602e41d99f"} Jul 24 09:59:04.734163 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.734140 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:59:04.758414 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.758361 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6f5tr" podStartSLOduration=34.091192398 podStartE2EDuration="48.758344134s" totalImagesPullingTime="14.667151736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:58:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:04.757494472 +0000 UTC m=+139.166981573" watchObservedRunningTime="2026-07-24 09:59:04.758344134 +0000 UTC m=+139.167831210" Jul 24 09:59:04.851149 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:04.851117 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v8sms"] Jul 24 09:59:04.853937 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:04.853911 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183b25df_3a2f_4b7a_97e5_aadbb5089e7c.slice/crio-e1225e9d3e1f3d82dd3f0e7b158180110680232f541962ae950aa22dc55e2cca WatchSource:0}: Error finding container e1225e9d3e1f3d82dd3f0e7b158180110680232f541962ae950aa22dc55e2cca: Status 404 returned error can't find the container with id e1225e9d3e1f3d82dd3f0e7b158180110680232f541962ae950aa22dc55e2cca Jul 24 09:59:05.733961 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:05.733929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" event={"ID":"183b25df-3a2f-4b7a-97e5-aadbb5089e7c","Type":"ContainerStarted","Data":"e1225e9d3e1f3d82dd3f0e7b158180110680232f541962ae950aa22dc55e2cca"} Jul 24 09:59:06.738083 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:06.738047 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" event={"ID":"183b25df-3a2f-4b7a-97e5-aadbb5089e7c","Type":"ContainerStarted","Data":"b33698d641a619209b50ed581166223d62d6db477a2428532bef7e5fc9040a8b"} Jul 24 09:59:06.738458 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:06.738109 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" event={"ID":"183b25df-3a2f-4b7a-97e5-aadbb5089e7c","Type":"ContainerStarted","Data":"737c8803bd10c3f1ac3c47ff4d867078413c1d899dcd9ecdbad201fc80784f03"} Jul 24 09:59:06.766444 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:06.766397 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-v8sms" podStartSLOduration=2.524003833 podStartE2EDuration="3.766382654s" totalImagesPullingTime="1.242378821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:06.764364435 +0000 UTC m=+141.173851512" watchObservedRunningTime="2026-07-24 09:59:06.766382654 +0000 UTC m=+141.175869731" Jul 24 09:59:09.135805 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.131778 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt"] Jul 24 09:59:09.137573 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.137552 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.140450 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.140425 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 09:59:09.140636 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.140617 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dvwr5\"" Jul 24 09:59:09.141128 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.141109 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 09:59:09.145038 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.144738 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt"] Jul 24 09:59:09.147532 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.147512 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f67kn"] Jul 24 09:59:09.152840 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.152820 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq"] Jul 24 09:59:09.152980 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.152960 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.155214 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.155193 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 09:59:09.155660 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.155636 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 09:59:09.155813 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.155641 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8d6b2\"" Jul 24 09:59:09.156803 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.156786 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.157629 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.157613 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 09:59:09.159126 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.159105 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8lqdd\"" Jul 24 09:59:09.159412 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.159396 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 09:59:09.159636 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.159620 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 09:59:09.159718 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.159649 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 09:59:09.169591 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.169438 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq"] Jul 24 09:59:09.213070 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.213045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmc5h\" (UniqueName: \"kubernetes.io/projected/c1edc951-d544-4257-aa8c-2a28abfa09f2-kube-api-access-fmc5h\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.213270 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.213087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1edc951-d544-4257-aa8c-2a28abfa09f2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.213270 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.213103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1edc951-d544-4257-aa8c-2a28abfa09f2-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.213270 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.213126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1edc951-d544-4257-aa8c-2a28abfa09f2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.313738 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.313708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmc5h\" (UniqueName: \"kubernetes.io/projected/c1edc951-d544-4257-aa8c-2a28abfa09f2-kube-api-access-fmc5h\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.313901 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.313747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-tls\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.313901 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.313767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05302515-8fb3-4249-8bdd-1161d88415e6-metrics-client-ca\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.313901 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.313783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwnlt\" (UniqueName: \"kubernetes.io/projected/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-api-access-mwnlt\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.313901 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.313830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.313901 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.313881 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.314150 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.313936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05302515-8fb3-4249-8bdd-1161d88415e6-sys\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.314150 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.314150 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1edc951-d544-4257-aa8c-2a28abfa09f2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.314150 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.314150 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1edc951-d544-4257-aa8c-2a28abfa09f2-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.314150 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314135 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.314558 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p886\" (UniqueName: \"kubernetes.io/projected/05302515-8fb3-4249-8bdd-1161d88415e6-kube-api-access-6p886\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.314558 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1edc951-d544-4257-aa8c-2a28abfa09f2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.314558 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-textfile\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.314558 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.314558 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05302515-8fb3-4249-8bdd-1161d88415e6-root\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.314558 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-wtmp\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.314558 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.315039 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.314761 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1edc951-d544-4257-aa8c-2a28abfa09f2-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.316618 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.316599 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1edc951-d544-4257-aa8c-2a28abfa09f2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.316725 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.316666 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1edc951-d544-4257-aa8c-2a28abfa09f2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.325272 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.325222 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmc5h\" (UniqueName: \"kubernetes.io/projected/c1edc951-d544-4257-aa8c-2a28abfa09f2-kube-api-access-fmc5h\") pod \"openshift-state-metrics-b8f49f5c6-7whnt\" (UID: \"c1edc951-d544-4257-aa8c-2a28abfa09f2\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.415490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415426 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-tls\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.415490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415458 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05302515-8fb3-4249-8bdd-1161d88415e6-metrics-client-ca\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.415490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwnlt\" (UniqueName: \"kubernetes.io/projected/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-api-access-mwnlt\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.415490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.415718 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.415718 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05302515-8fb3-4249-8bdd-1161d88415e6-sys\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.415718 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.415718 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.415718 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:59:09.415615 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 24 09:59:09.415718 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.415718 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p886\" (UniqueName: \"kubernetes.io/projected/05302515-8fb3-4249-8bdd-1161d88415e6-kube-api-access-6p886\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.415718 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:59:09.415691 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-tls podName:fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa nodeName:}" failed. No retries permitted until 2026-07-24 09:59:09.915669146 +0000 UTC m=+144.325156209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-pkjzq" (UID: "fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa") : secret "kube-state-metrics-tls" not found Jul 24 09:59:09.416067 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-textfile\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416067 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415754 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.416067 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05302515-8fb3-4249-8bdd-1161d88415e6-root\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416067 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-wtmp\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416067 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.415842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416311 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.416149 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-textfile\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416361 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.416261 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05302515-8fb3-4249-8bdd-1161d88415e6-metrics-client-ca\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416458 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.416430 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05302515-8fb3-4249-8bdd-1161d88415e6-root\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416458 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.416436 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416565 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.416531 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.416565 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.416558 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-wtmp\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416672 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.416590 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.416672 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.416621 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05302515-8fb3-4249-8bdd-1161d88415e6-sys\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.416770 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.416743 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.418092 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.418071 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-tls\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.418601 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.418585 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05302515-8fb3-4249-8bdd-1161d88415e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.419117 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.419096 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.428410 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.428385 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p886\" (UniqueName: \"kubernetes.io/projected/05302515-8fb3-4249-8bdd-1161d88415e6-kube-api-access-6p886\") pod \"node-exporter-f67kn\" (UID: \"05302515-8fb3-4249-8bdd-1161d88415e6\") " pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.428668 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.428652 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwnlt\" (UniqueName: \"kubernetes.io/projected/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-api-access-mwnlt\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.450749 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.450727 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" Jul 24 09:59:09.466692 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.466673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f67kn" Jul 24 09:59:09.477466 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:09.477443 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05302515_8fb3_4249_8bdd_1161d88415e6.slice/crio-49e14d8baf25ebaf615286dd928858557b2d20ccd3b87ecee26337e0c5bfe0db WatchSource:0}: Error finding container 49e14d8baf25ebaf615286dd928858557b2d20ccd3b87ecee26337e0c5bfe0db: Status 404 returned error can't find the container with id 49e14d8baf25ebaf615286dd928858557b2d20ccd3b87ecee26337e0c5bfe0db Jul 24 09:59:09.597072 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.597039 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt"] Jul 24 09:59:09.599484 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:09.599450 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1edc951_d544_4257_aa8c_2a28abfa09f2.slice/crio-39cc4cf92337049dd0f51b8c8c908faec6740073d88c0e56122b0ca4894afa50 WatchSource:0}: Error finding container 39cc4cf92337049dd0f51b8c8c908faec6740073d88c0e56122b0ca4894afa50: Status 404 returned error can't find the container with id 39cc4cf92337049dd0f51b8c8c908faec6740073d88c0e56122b0ca4894afa50 Jul 24 09:59:09.748878 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.748851 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" event={"ID":"c1edc951-d544-4257-aa8c-2a28abfa09f2","Type":"ContainerStarted","Data":"ab969cf7d1a68ed632168db26648c8de269456134f5d0176e9f2355b549f493e"} Jul 24 09:59:09.748994 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.748911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" event={"ID":"c1edc951-d544-4257-aa8c-2a28abfa09f2","Type":"ContainerStarted","Data":"968bb0fcd63a4c98065bcd73eb3a99a2d662177bfc2520f49a9236fe37c6045e"} Jul 24 09:59:09.748994 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.748942 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" event={"ID":"c1edc951-d544-4257-aa8c-2a28abfa09f2","Type":"ContainerStarted","Data":"39cc4cf92337049dd0f51b8c8c908faec6740073d88c0e56122b0ca4894afa50"} Jul 24 09:59:09.749926 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.749904 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f67kn" event={"ID":"05302515-8fb3-4249-8bdd-1161d88415e6","Type":"ContainerStarted","Data":"49e14d8baf25ebaf615286dd928858557b2d20ccd3b87ecee26337e0c5bfe0db"} Jul 24 09:59:09.920247 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.920142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:09.923103 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:09.923074 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pkjzq\" (UID: \"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:10.072559 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.072519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" Jul 24 09:59:10.226765 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.226716 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq"] Jul 24 09:59:10.302514 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.302469 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:59:10.307942 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.307919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.311211 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.311157 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 09:59:10.311211 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.311156 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 09:59:10.311866 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.311574 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 09:59:10.311866 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.311621 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 09:59:10.311866 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.311627 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 09:59:10.311866 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.311742 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 09:59:10.312148 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.312016 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 09:59:10.312226 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.312209 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t95jr\"" Jul 24 09:59:10.312543 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.312373 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 09:59:10.318312 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.318274 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 09:59:10.326004 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.325983 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:59:10.357315 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:10.357284 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd59d9bb_60bc_46bc_acbf_d1d6342bf4aa.slice/crio-4e69acbdfb1a178b0c18878cc098f24978770b11585f011b139903a0c6ec55b7 WatchSource:0}: Error finding container 4e69acbdfb1a178b0c18878cc098f24978770b11585f011b139903a0c6ec55b7: Status 404 returned error can't find the container with id 4e69acbdfb1a178b0c18878cc098f24978770b11585f011b139903a0c6ec55b7 Jul 24 09:59:10.426321 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vn46\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-kube-api-access-9vn46\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426427 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-web-config\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426427 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426358 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426427 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426561 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426561 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426504 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426561 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426675 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426675 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426675 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426675 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426663 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426803 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.426803 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.426701 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-out\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.527919 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.527846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.527919 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.527893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528101 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.527921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528101 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.527941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528101 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.527958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528101 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.527974 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528101 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.527992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-out\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528101 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.528025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vn46\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-kube-api-access-9vn46\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528101 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:59:10.528044 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 24 09:59:10.528452 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:59:10.528109 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-main-tls podName:ae8c61bd-c744-4c93-b678-4de1d82e38ef nodeName:}" failed. No retries permitted until 2026-07-24 09:59:11.028088962 +0000 UTC m=+145.437576023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef") : secret "alertmanager-main-tls" not found Jul 24 09:59:10.528452 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.528048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-web-config\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528452 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.528338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528452 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.528369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528452 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.528411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.528452 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.528451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.530497 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.529059 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.530497 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.529204 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.530732 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.530688 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.531280 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.531201 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.531383 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.531350 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-web-config\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.531747 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.531722 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.531887 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.531868 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-out\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.531969 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.531947 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.532872 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.532837 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.533573 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.533544 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.534053 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.534030 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.538721 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.538700 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vn46\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-kube-api-access-9vn46\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:10.755986 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.755950 2563 generic.go:356] "Generic (PLEG): container finished" podID="05302515-8fb3-4249-8bdd-1161d88415e6" containerID="e86cf839dccbe6d6284159bcb60243622ea807d708c9f2746f94ab6315dd1bb9" exitCode=0 Jul 24 09:59:10.756149 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.756036 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f67kn" event={"ID":"05302515-8fb3-4249-8bdd-1161d88415e6","Type":"ContainerDied","Data":"e86cf839dccbe6d6284159bcb60243622ea807d708c9f2746f94ab6315dd1bb9"} Jul 24 09:59:10.757248 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:10.757212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" event={"ID":"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa","Type":"ContainerStarted","Data":"4e69acbdfb1a178b0c18878cc098f24978770b11585f011b139903a0c6ec55b7"} Jul 24 09:59:11.033813 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.033786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:11.036048 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.036025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:11.168280 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.168217 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt"] Jul 24 09:59:11.172080 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.172055 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.175559 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.175535 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 09:59:11.175559 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.175556 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-40ooe7kgg8e42\"" Jul 24 09:59:11.175955 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.175790 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 09:59:11.175955 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.175835 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-s6f6r\"" Jul 24 09:59:11.194013 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.193992 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 09:59:11.194203 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.194171 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 09:59:11.195764 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.195744 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt"] Jul 24 09:59:11.202988 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.202962 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 09:59:11.239486 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.239413 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:59:11.337041 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.336797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d69f8f-00c5-4559-8521-1c7adafc5966-metrics-client-ca\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.337041 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.336870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.337041 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.336902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.337041 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.336929 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-grpc-tls\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.337041 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.336952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jncl\" (UniqueName: \"kubernetes.io/projected/88d69f8f-00c5-4559-8521-1c7adafc5966-kube-api-access-2jncl\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.337041 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.336990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.337471 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.337089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-tls\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.337471 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.337143 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.398456 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.398426 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:59:11.401883 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:11.401852 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae8c61bd_c744_4c93_b678_4de1d82e38ef.slice/crio-0bc7ae512c734b184c28e206f9b31ff17217f156387e8a16e18589baf7dabc94 WatchSource:0}: Error finding container 0bc7ae512c734b184c28e206f9b31ff17217f156387e8a16e18589baf7dabc94: Status 404 returned error can't find the container with id 0bc7ae512c734b184c28e206f9b31ff17217f156387e8a16e18589baf7dabc94 Jul 24 09:59:11.438068 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.438041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.438196 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.438080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.438196 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.438103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-grpc-tls\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.438196 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.438128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jncl\" (UniqueName: \"kubernetes.io/projected/88d69f8f-00c5-4559-8521-1c7adafc5966-kube-api-access-2jncl\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.438196 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.438163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.438580 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.438559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-tls\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.438656 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.438616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.438706 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.438666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d69f8f-00c5-4559-8521-1c7adafc5966-metrics-client-ca\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.439605 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.439546 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d69f8f-00c5-4559-8521-1c7adafc5966-metrics-client-ca\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.441601 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.441575 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.441690 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.441601 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.441690 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.441621 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-grpc-tls\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.441930 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.441904 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.442094 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.442067 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-tls\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.443089 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.443068 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/88d69f8f-00c5-4559-8521-1c7adafc5966-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.447114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.447097 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jncl\" (UniqueName: \"kubernetes.io/projected/88d69f8f-00c5-4559-8521-1c7adafc5966-kube-api-access-2jncl\") pod \"thanos-querier-56c8f7cb99-vsvrt\" (UID: \"88d69f8f-00c5-4559-8521-1c7adafc5966\") " pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.484271 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.484220 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:11.764321 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.764283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f67kn" event={"ID":"05302515-8fb3-4249-8bdd-1161d88415e6","Type":"ContainerStarted","Data":"c33256a6660239d2179cc65b79baf4a07512aab693ab4b3e01d8f2eea4fddd41"} Jul 24 09:59:11.764519 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.764349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f67kn" event={"ID":"05302515-8fb3-4249-8bdd-1161d88415e6","Type":"ContainerStarted","Data":"b51138c42eb7409f43a11b2a295fdbedfe599dce52a89225b204d1a30c88a484"} Jul 24 09:59:11.766647 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.766614 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" event={"ID":"c1edc951-d544-4257-aa8c-2a28abfa09f2","Type":"ContainerStarted","Data":"f6db4dc693b49eab5650f02c8f184e7d9df40f1eed730acdbf8b0cce57f59588"} Jul 24 09:59:11.767867 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.767839 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerStarted","Data":"0bc7ae512c734b184c28e206f9b31ff17217f156387e8a16e18589baf7dabc94"} Jul 24 09:59:11.787403 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.787350 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f67kn" podStartSLOduration=1.792983161 podStartE2EDuration="2.78733343s" totalImagesPullingTime="923.950455ms" totalInitContainerRuntime="70.399814ms" isStatefulPod=true podCreationTimestamp="2026-07-24 09:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:11.786185432 +0000 UTC m=+146.195672523" watchObservedRunningTime="2026-07-24 09:59:11.78733343 +0000 UTC m=+146.196820499" Jul 24 09:59:11.807339 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.807289 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7whnt" podStartSLOduration=1.51618859 podStartE2EDuration="2.807271895s" totalImagesPullingTime="1.291083305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:11.806160206 +0000 UTC m=+146.215647283" watchObservedRunningTime="2026-07-24 09:59:11.807271895 +0000 UTC m=+146.216758971" Jul 24 09:59:11.919981 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:11.919953 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt"] Jul 24 09:59:11.923918 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:11.923883 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d69f8f_00c5_4559_8521_1c7adafc5966.slice/crio-1769d434c2c17b1b4d2d5cdec08bfdfaca1d355254853523f05fa51ed6d8c28a WatchSource:0}: Error finding container 1769d434c2c17b1b4d2d5cdec08bfdfaca1d355254853523f05fa51ed6d8c28a: Status 404 returned error can't find the container with id 1769d434c2c17b1b4d2d5cdec08bfdfaca1d355254853523f05fa51ed6d8c28a Jul 24 09:59:12.773464 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:12.773429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" event={"ID":"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa","Type":"ContainerStarted","Data":"d79c682b2ceaddbca7926dc122dad6dcea7aa7a264257571710e025235f41a1b"} Jul 24 09:59:12.773867 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:12.773492 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" event={"ID":"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa","Type":"ContainerStarted","Data":"cf0fd71411139d642ca9085bb55538ca520f2c49211f6650100f9236f5e2901f"} Jul 24 09:59:12.773867 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:12.773519 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" event={"ID":"fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa","Type":"ContainerStarted","Data":"56daa516fe17f55c632917d7eb9c5cce7eca46c2dd5639125f683edba784286a"} Jul 24 09:59:12.774802 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:12.774779 2563 generic.go:356] "Generic (PLEG): container finished" podID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerID="d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19" exitCode=0 Jul 24 09:59:12.774886 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:12.774834 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerDied","Data":"d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19"} Jul 24 09:59:12.776022 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:12.775996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" event={"ID":"88d69f8f-00c5-4559-8521-1c7adafc5966","Type":"ContainerStarted","Data":"1769d434c2c17b1b4d2d5cdec08bfdfaca1d355254853523f05fa51ed6d8c28a"} Jul 24 09:59:12.811530 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:12.811480 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pkjzq" podStartSLOduration=2.3374606 podStartE2EDuration="3.811465704s" totalImagesPullingTime="1.474005104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:12.810875166 +0000 UTC m=+147.220362264" watchObservedRunningTime="2026-07-24 09:59:12.811465704 +0000 UTC m=+147.220952780" Jul 24 09:59:14.786603 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:14.786561 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerStarted","Data":"3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e"} Jul 24 09:59:14.787029 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:14.786629 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerStarted","Data":"b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e"} Jul 24 09:59:15.412261 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.412213 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:59:15.416947 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.416918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.420825 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.420596 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hvstv\"" Jul 24 09:59:15.420825 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.420626 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 09:59:15.420825 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.420699 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 09:59:15.421493 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.421473 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 09:59:15.422356 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.422335 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5n702dsb04nqb\"" Jul 24 09:59:15.423343 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.423312 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 09:59:15.423445 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.423343 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 09:59:15.423680 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.423665 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 09:59:15.423680 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.423676 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 09:59:15.423819 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.423720 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 09:59:15.423819 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.423763 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 09:59:15.423975 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.423960 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 09:59:15.424048 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.424025 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 09:59:15.424102 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.424031 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 09:59:15.424339 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.424323 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 09:59:15.424937 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.424898 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 09:59:15.425702 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.425685 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 09:59:15.444421 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.444385 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:59:15.583060 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583224 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-config\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583224 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583224 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583224 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583497 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583257 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x79mf\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-kube-api-access-x79mf\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583497 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583497 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583497 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583388 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583497 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583497 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583497 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583481 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583821 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583821 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583821 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583550 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583821 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583821 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583821 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583821 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.583821 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.583755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685115 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.684896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685115 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.684952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685115 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.684981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685115 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685115 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685115 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685115 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685115 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685105 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685674 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685674 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685674 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685180 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685674 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685674 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685674 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-config\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685674 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.685998 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.685971 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.686218 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.686162 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.687114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.686802 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.687114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.686876 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.687114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.686905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.687114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.686934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x79mf\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-kube-api-access-x79mf\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.687114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.686962 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.687114 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.686995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.688070 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.687751 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.688772 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.688746 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.688867 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.688773 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.688969 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.688945 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.689037 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.688963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.689179 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.689156 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.689530 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.689485 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.689530 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.689513 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.689937 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.689909 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.691086 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.691059 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-config\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.691304 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.691262 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.692272 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.692201 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.692420 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.692395 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.692659 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.692634 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.692848 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.692830 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.693362 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.693338 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.718561 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.718528 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x79mf\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-kube-api-access-x79mf\") pod \"prometheus-k8s-0\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.730141 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.730102 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:15.797546 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.797504 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerStarted","Data":"8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec"} Jul 24 09:59:15.797986 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.797582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerStarted","Data":"bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e"} Jul 24 09:59:15.797986 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.797609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerStarted","Data":"1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35"} Jul 24 09:59:15.805002 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.804966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" event={"ID":"88d69f8f-00c5-4559-8521-1c7adafc5966","Type":"ContainerStarted","Data":"a81103ee2ee448daf0be881fc1c6703035267ffa5cbcf408f38a12c23e9faf68"} Jul 24 09:59:15.805164 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.805044 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" event={"ID":"88d69f8f-00c5-4559-8521-1c7adafc5966","Type":"ContainerStarted","Data":"53c1f41d31c2fc1e03c343c892246d97917351a90d1bd0a052e0ca5e7aa8b405"} Jul 24 09:59:15.805164 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:15.805080 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" event={"ID":"88d69f8f-00c5-4559-8521-1c7adafc5966","Type":"ContainerStarted","Data":"cc77f4891c1cebeff11521251bfd10dc6da7f1139dfbe6775f17cf360570ccef"} Jul 24 09:59:16.032378 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.032350 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:59:16.033659 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:16.033630 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28629791_6b40_4df4_8384_e3c52a886a1e.slice/crio-bf7605f62a607ae5f9c0e2fcabfcfad31c00952f6b5167a24f9a2c182ed99f55 WatchSource:0}: Error finding container bf7605f62a607ae5f9c0e2fcabfcfad31c00952f6b5167a24f9a2c182ed99f55: Status 404 returned error can't find the container with id bf7605f62a607ae5f9c0e2fcabfcfad31c00952f6b5167a24f9a2c182ed99f55 Jul 24 09:59:16.810719 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.810685 2563 generic.go:356] "Generic (PLEG): container finished" podID="28629791-6b40-4df4-8384-e3c52a886a1e" containerID="77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e" exitCode=0 Jul 24 09:59:16.811163 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.810764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerDied","Data":"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e"} Jul 24 09:59:16.811163 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.810861 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerStarted","Data":"bf7605f62a607ae5f9c0e2fcabfcfad31c00952f6b5167a24f9a2c182ed99f55"} Jul 24 09:59:16.814272 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.814249 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerStarted","Data":"438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6"} Jul 24 09:59:16.817176 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.817152 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" event={"ID":"88d69f8f-00c5-4559-8521-1c7adafc5966","Type":"ContainerStarted","Data":"008ed561ca9d7cfdacefcd160dd00606fdfdb2e9a549c0deaa0c7a4d0ea1025e"} Jul 24 09:59:16.817267 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.817216 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" event={"ID":"88d69f8f-00c5-4559-8521-1c7adafc5966","Type":"ContainerStarted","Data":"257d3f20df3bf71a1c169fb08cc40b666c2636467a03710f74b515cc74eaa0b9"} Jul 24 09:59:16.817307 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.817276 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" event={"ID":"88d69f8f-00c5-4559-8521-1c7adafc5966","Type":"ContainerStarted","Data":"c903bebc266114778666c27ab3d67c0fadb8a3f6120a4a06119be7c54a4f70bf"} Jul 24 09:59:16.817516 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.817307 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:16.846934 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.846912 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-747f64484c-w8zxh"] Jul 24 09:59:16.847161 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:59:16.847143 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-747f64484c-w8zxh" podUID="d234846d-5a02-4ac3-afef-576c1a05c8cd" Jul 24 09:59:16.970002 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:16.969943 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.479037126 podStartE2EDuration="6.9699259s" totalImagesPullingTime="3.475836809s" totalInitContainerRuntime="15.051965ms" isStatefulPod=false podCreationTimestamp="2026-07-24 09:59:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:16.968319842 +0000 UTC m=+151.377806919" watchObservedRunningTime="2026-07-24 09:59:16.9699259 +0000 UTC m=+151.379412977" Jul 24 09:59:17.013576 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:17.013512 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" podStartSLOduration=2.25982533 podStartE2EDuration="6.0134908s" totalImagesPullingTime="3.75366547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:59:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:17.012111878 +0000 UTC m=+151.421599004" watchObservedRunningTime="2026-07-24 09:59:17.0134908 +0000 UTC m=+151.422977878" Jul 24 09:59:17.821952 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:17.821913 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:59:17.829831 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:17.829810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:59:18.008685 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.008645 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-image-registry-private-configuration\") pod \"d234846d-5a02-4ac3-afef-576c1a05c8cd\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " Jul 24 09:59:18.008849 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.008696 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qb5n\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-kube-api-access-9qb5n\") pod \"d234846d-5a02-4ac3-afef-576c1a05c8cd\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " Jul 24 09:59:18.008849 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.008750 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-bound-sa-token\") pod \"d234846d-5a02-4ac3-afef-576c1a05c8cd\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " Jul 24 09:59:18.008849 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.008775 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-trusted-ca\") pod \"d234846d-5a02-4ac3-afef-576c1a05c8cd\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " Jul 24 09:59:18.008849 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.008837 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d234846d-5a02-4ac3-afef-576c1a05c8cd-ca-trust-extracted\") pod \"d234846d-5a02-4ac3-afef-576c1a05c8cd\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " Jul 24 09:59:18.009048 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.008886 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-installation-pull-secrets\") pod \"d234846d-5a02-4ac3-afef-576c1a05c8cd\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " Jul 24 09:59:18.009048 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.008920 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-certificates\") pod \"d234846d-5a02-4ac3-afef-576c1a05c8cd\" (UID: \"d234846d-5a02-4ac3-afef-576c1a05c8cd\") " Jul 24 09:59:18.009369 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.009341 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d234846d-5a02-4ac3-afef-576c1a05c8cd" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:59:18.009369 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.009363 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d234846d-5a02-4ac3-afef-576c1a05c8cd" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:59:18.009569 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.009547 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-trusted-ca\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:18.009636 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.009578 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-certificates\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:18.011032 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.011006 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d234846d-5a02-4ac3-afef-576c1a05c8cd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d234846d-5a02-4ac3-afef-576c1a05c8cd" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 09:59:18.011664 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.011636 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d234846d-5a02-4ac3-afef-576c1a05c8cd" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:59:18.011760 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.011671 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d234846d-5a02-4ac3-afef-576c1a05c8cd" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:59:18.011833 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.011764 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-kube-api-access-9qb5n" (OuterVolumeSpecName: "kube-api-access-9qb5n") pod "d234846d-5a02-4ac3-afef-576c1a05c8cd" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd"). InnerVolumeSpecName "kube-api-access-9qb5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:59:18.011993 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.011962 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d234846d-5a02-4ac3-afef-576c1a05c8cd" (UID: "d234846d-5a02-4ac3-afef-576c1a05c8cd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:59:18.110854 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.110775 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-installation-pull-secrets\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:18.110854 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.110810 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d234846d-5a02-4ac3-afef-576c1a05c8cd-image-registry-private-configuration\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:18.110854 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.110825 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qb5n\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-kube-api-access-9qb5n\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:18.110854 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.110839 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-bound-sa-token\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:18.110854 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.110853 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d234846d-5a02-4ac3-afef-576c1a05c8cd-ca-trust-extracted\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:18.826071 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.826030 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747f64484c-w8zxh" Jul 24 09:59:18.893695 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.893658 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-747f64484c-w8zxh"] Jul 24 09:59:18.906458 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.906423 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-747f64484c-w8zxh"] Jul 24 09:59:18.917365 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:18.917336 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d234846d-5a02-4ac3-afef-576c1a05c8cd-registry-tls\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:19.793516 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.793485 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-564cc8ff5f-w62bk"] Jul 24 09:59:19.798862 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.798307 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.817844 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.817816 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 09:59:19.822778 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.822747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-config\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.822884 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.822788 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-trusted-ca-bundle\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.822884 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.822834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-oauth-config\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.822980 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.822900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-oauth-serving-cert\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.822980 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.822930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-serving-cert\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.822980 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.822961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq7ls\" (UniqueName: \"kubernetes.io/projected/ee2990bc-41f7-4a25-92f0-d285d0d2babf-kube-api-access-hq7ls\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.823087 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.822985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-service-ca\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.828367 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.828344 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564cc8ff5f-w62bk"] Jul 24 09:59:19.923748 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.923719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-config\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.923856 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.923771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-trusted-ca-bundle\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.923856 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.923833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-oauth-config\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.923953 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.923862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-oauth-serving-cert\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.924077 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.924052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-serving-cert\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.924154 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.924104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq7ls\" (UniqueName: \"kubernetes.io/projected/ee2990bc-41f7-4a25-92f0-d285d0d2babf-kube-api-access-hq7ls\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.924154 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.924140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-service-ca\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.924588 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.924560 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-config\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.924675 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.924618 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-oauth-serving-cert\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.924765 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.924714 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-trusted-ca-bundle\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.924853 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.924830 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-service-ca\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.926761 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.926709 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-oauth-config\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.927248 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.927204 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-serving-cert\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:19.938761 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:19.938740 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq7ls\" (UniqueName: \"kubernetes.io/projected/ee2990bc-41f7-4a25-92f0-d285d0d2babf-kube-api-access-hq7ls\") pod \"console-564cc8ff5f-w62bk\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:20.111972 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.111934 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:20.175654 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.175614 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d234846d-5a02-4ac3-afef-576c1a05c8cd" path="/var/lib/kubelet/pods/d234846d-5a02-4ac3-afef-576c1a05c8cd/volumes" Jul 24 09:59:20.325118 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:20.325083 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2990bc_41f7_4a25_92f0_d285d0d2babf.slice/crio-2c6d05831ddd93e0ec2fb4059ff6429ae0750261bc811797affcb4c42503a0a4 WatchSource:0}: Error finding container 2c6d05831ddd93e0ec2fb4059ff6429ae0750261bc811797affcb4c42503a0a4: Status 404 returned error can't find the container with id 2c6d05831ddd93e0ec2fb4059ff6429ae0750261bc811797affcb4c42503a0a4 Jul 24 09:59:20.325321 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.325293 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564cc8ff5f-w62bk"] Jul 24 09:59:20.837009 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.836962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerStarted","Data":"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a"} Jul 24 09:59:20.837444 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.837053 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerStarted","Data":"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91"} Jul 24 09:59:20.837444 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.837108 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerStarted","Data":"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573"} Jul 24 09:59:20.837444 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.837149 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerStarted","Data":"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817"} Jul 24 09:59:20.837444 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.837180 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerStarted","Data":"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb"} Jul 24 09:59:20.837444 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.837249 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerStarted","Data":"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15"} Jul 24 09:59:20.838474 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.838452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564cc8ff5f-w62bk" event={"ID":"ee2990bc-41f7-4a25-92f0-d285d0d2babf","Type":"ContainerStarted","Data":"d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4"} Jul 24 09:59:20.838580 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.838485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564cc8ff5f-w62bk" event={"ID":"ee2990bc-41f7-4a25-92f0-d285d0d2babf","Type":"ContainerStarted","Data":"2c6d05831ddd93e0ec2fb4059ff6429ae0750261bc811797affcb4c42503a0a4"} Jul 24 09:59:20.914311 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.914253 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.804238992 podStartE2EDuration="5.914210322s" totalImagesPullingTime="3.08811436s" totalInitContainerRuntime="21.85697ms" isStatefulPod=false podCreationTimestamp="2026-07-24 09:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:20.910343686 +0000 UTC m=+155.319830780" watchObservedRunningTime="2026-07-24 09:59:20.914210322 +0000 UTC m=+155.323697409" Jul 24 09:59:20.942398 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:20.942347 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-564cc8ff5f-w62bk" podStartSLOduration=1.942331968 podStartE2EDuration="1.942331968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:59:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:20.939466742 +0000 UTC m=+155.348953821" watchObservedRunningTime="2026-07-24 09:59:20.942331968 +0000 UTC m=+155.351819044" Jul 24 09:59:22.827743 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:22.827717 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56c8f7cb99-vsvrt" Jul 24 09:59:24.546569 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:59:24.546514 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vqjvn" podUID="9fdaaa75-19aa-4893-bfda-859e275d1e49" Jul 24 09:59:24.859205 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:24.859168 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vqjvn" Jul 24 09:59:25.730432 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:25.730399 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:59:29.509146 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:29.509108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:59:29.511638 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:29.511610 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdaaa75-19aa-4893-bfda-859e275d1e49-metrics-tls\") pod \"dns-default-vqjvn\" (UID: \"9fdaaa75-19aa-4893-bfda-859e275d1e49\") " pod="openshift-dns/dns-default-vqjvn" Jul 24 09:59:29.662682 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:29.662648 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xgf8p\"" Jul 24 09:59:29.671213 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:29.671193 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vqjvn" Jul 24 09:59:29.828937 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:29.828838 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vqjvn"] Jul 24 09:59:29.831173 ip-10-0-131-23 kubenswrapper[2563]: W0724 09:59:29.831135 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdaaa75_19aa_4893_bfda_859e275d1e49.slice/crio-00c10d03e1cde6fdcd468f3f9e664d78240c45275eff555a5bf183766f3bed3e WatchSource:0}: Error finding container 00c10d03e1cde6fdcd468f3f9e664d78240c45275eff555a5bf183766f3bed3e: Status 404 returned error can't find the container with id 00c10d03e1cde6fdcd468f3f9e664d78240c45275eff555a5bf183766f3bed3e Jul 24 09:59:29.879723 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:29.879691 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vqjvn" event={"ID":"9fdaaa75-19aa-4893-bfda-859e275d1e49","Type":"ContainerStarted","Data":"00c10d03e1cde6fdcd468f3f9e664d78240c45275eff555a5bf183766f3bed3e"} Jul 24 09:59:30.112372 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:30.112337 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:30.112547 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:30.112404 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:30.117399 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:30.117368 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:30.888960 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:30.888930 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 09:59:30.943113 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:30.943073 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dc6867bc4-rtl8p"] Jul 24 09:59:32.747215 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:32.747190 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hw722_51252953-771c-415b-ac0c-aeda706ffb9c/dns-node-resolver/0.log" Jul 24 09:59:32.895127 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:32.895094 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vqjvn" event={"ID":"9fdaaa75-19aa-4893-bfda-859e275d1e49","Type":"ContainerStarted","Data":"b66f3cbe2c28e430a8135b5140733984677e9e96233be6f69330acb6b914fe38"} Jul 24 09:59:32.895334 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:32.895173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vqjvn" event={"ID":"9fdaaa75-19aa-4893-bfda-859e275d1e49","Type":"ContainerStarted","Data":"b4ea7d943ad70ae5b8c6084de83a0aa29432335f063f853446e5328594f4c509"} Jul 24 09:59:32.895334 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:32.895265 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vqjvn" Jul 24 09:59:32.923994 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:32.923948 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vqjvn" podStartSLOduration=129.517478361 podStartE2EDuration="2m11.923931199s" totalImagesPullingTime="2.406452838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:59:32.922275412 +0000 UTC m=+167.331762489" watchObservedRunningTime="2026-07-24 09:59:32.923931199 +0000 UTC m=+167.333418277" Jul 24 09:59:42.902401 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:42.902373 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vqjvn" Jul 24 09:59:55.965813 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:55.965743 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dc6867bc4-rtl8p" podUID="fddd1d45-7519-46f9-adc5-cec86be6c470" containerName="console" containerID="cri-o://e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9" gracePeriod=15 Jul 24 09:59:56.215537 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.215513 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:59:56.359490 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.359455 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-service-ca\") pod \"fddd1d45-7519-46f9-adc5-cec86be6c470\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " Jul 24 09:59:56.359686 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.359499 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-serving-cert\") pod \"fddd1d45-7519-46f9-adc5-cec86be6c470\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " Jul 24 09:59:56.359686 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.359519 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-oauth-serving-cert\") pod \"fddd1d45-7519-46f9-adc5-cec86be6c470\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " Jul 24 09:59:56.359686 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.359540 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-oauth-config\") pod \"fddd1d45-7519-46f9-adc5-cec86be6c470\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " Jul 24 09:59:56.359686 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.359668 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj4cp\" (UniqueName: \"kubernetes.io/projected/fddd1d45-7519-46f9-adc5-cec86be6c470-kube-api-access-cj4cp\") pod \"fddd1d45-7519-46f9-adc5-cec86be6c470\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " Jul 24 09:59:56.359893 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.359725 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-console-config\") pod \"fddd1d45-7519-46f9-adc5-cec86be6c470\" (UID: \"fddd1d45-7519-46f9-adc5-cec86be6c470\") " Jul 24 09:59:56.359965 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.359934 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fddd1d45-7519-46f9-adc5-cec86be6c470" (UID: "fddd1d45-7519-46f9-adc5-cec86be6c470"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:59:56.359965 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.359948 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-service-ca" (OuterVolumeSpecName: "service-ca") pod "fddd1d45-7519-46f9-adc5-cec86be6c470" (UID: "fddd1d45-7519-46f9-adc5-cec86be6c470"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:59:56.360099 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.360084 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-service-ca\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:56.360145 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.360102 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-oauth-serving-cert\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:56.360145 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.360105 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-console-config" (OuterVolumeSpecName: "console-config") pod "fddd1d45-7519-46f9-adc5-cec86be6c470" (UID: "fddd1d45-7519-46f9-adc5-cec86be6c470"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:59:56.361983 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.361966 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fddd1d45-7519-46f9-adc5-cec86be6c470" (UID: "fddd1d45-7519-46f9-adc5-cec86be6c470"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:59:56.362278 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.362252 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fddd1d45-7519-46f9-adc5-cec86be6c470" (UID: "fddd1d45-7519-46f9-adc5-cec86be6c470"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:59:56.362278 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.362265 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddd1d45-7519-46f9-adc5-cec86be6c470-kube-api-access-cj4cp" (OuterVolumeSpecName: "kube-api-access-cj4cp") pod "fddd1d45-7519-46f9-adc5-cec86be6c470" (UID: "fddd1d45-7519-46f9-adc5-cec86be6c470"). InnerVolumeSpecName "kube-api-access-cj4cp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:59:56.460784 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.460745 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj4cp\" (UniqueName: \"kubernetes.io/projected/fddd1d45-7519-46f9-adc5-cec86be6c470-kube-api-access-cj4cp\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:56.460784 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.460776 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fddd1d45-7519-46f9-adc5-cec86be6c470-console-config\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:56.460784 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.460785 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-serving-cert\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:56.460784 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:56.460794 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fddd1d45-7519-46f9-adc5-cec86be6c470-console-oauth-config\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 09:59:57.003509 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:57.003471 2563 generic.go:356] "Generic (PLEG): container finished" podID="fddd1d45-7519-46f9-adc5-cec86be6c470" containerID="e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9" exitCode=0 Jul 24 09:59:57.004086 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:57.003541 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc6867bc4-rtl8p" event={"ID":"fddd1d45-7519-46f9-adc5-cec86be6c470","Type":"ContainerDied","Data":"e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9"} Jul 24 09:59:57.004086 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:57.003571 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc6867bc4-rtl8p" Jul 24 09:59:57.004086 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:57.003592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc6867bc4-rtl8p" event={"ID":"fddd1d45-7519-46f9-adc5-cec86be6c470","Type":"ContainerDied","Data":"0909f69758f6a953f094389a925ad157ce8df8010f651027c32b862970f08e2d"} Jul 24 09:59:57.004086 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:57.003634 2563 scope.go:117] "RemoveContainer" containerID="e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9" Jul 24 09:59:57.013727 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:57.013706 2563 scope.go:117] "RemoveContainer" containerID="e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9" Jul 24 09:59:57.014094 ip-10-0-131-23 kubenswrapper[2563]: E0724 09:59:57.014065 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9\": container with ID starting with e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9 not found: ID does not exist" containerID="e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9" Jul 24 09:59:57.014167 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:57.014109 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9"} err="failed to get container status \"e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9\": rpc error: code = NotFound desc = could not find container \"e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9\": container with ID starting with e8d7e718cb10d80acd10c9ebbb9d7390b72be19fe1fb10618f734f9f3106dbf9 not found: ID does not exist" Jul 24 09:59:57.029484 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:57.029448 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dc6867bc4-rtl8p"] Jul 24 09:59:57.032967 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:57.032938 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dc6867bc4-rtl8p"] Jul 24 09:59:58.172255 ip-10-0-131-23 kubenswrapper[2563]: I0724 09:59:58.172199 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fddd1d45-7519-46f9-adc5-cec86be6c470" path="/var/lib/kubelet/pods/fddd1d45-7519-46f9-adc5-cec86be6c470/volumes" Jul 24 10:00:15.730937 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:15.730906 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:15.750330 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:15.750301 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:16.099070 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:16.099044 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:29.613400 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:29.613364 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 10:00:29.613927 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:29.613743 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="alertmanager" containerID="cri-o://b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e" gracePeriod=120 Jul 24 10:00:29.613927 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:29.613797 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy-metric" containerID="cri-o://8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec" gracePeriod=120 Jul 24 10:00:29.613927 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:29.613817 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy-web" containerID="cri-o://1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35" gracePeriod=120 Jul 24 10:00:29.613927 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:29.613856 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="prom-label-proxy" containerID="cri-o://438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6" gracePeriod=120 Jul 24 10:00:29.613927 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:29.613868 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="config-reloader" containerID="cri-o://3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e" gracePeriod=120 Jul 24 10:00:29.614146 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:29.613943 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy" containerID="cri-o://bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e" gracePeriod=120 Jul 24 10:00:30.144420 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.144381 2563 generic.go:356] "Generic (PLEG): container finished" podID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerID="438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6" exitCode=0 Jul 24 10:00:30.144420 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.144411 2563 generic.go:356] "Generic (PLEG): container finished" podID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerID="bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e" exitCode=0 Jul 24 10:00:30.144420 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.144419 2563 generic.go:356] "Generic (PLEG): container finished" podID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerID="3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e" exitCode=0 Jul 24 10:00:30.144420 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.144427 2563 generic.go:356] "Generic (PLEG): container finished" podID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerID="b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e" exitCode=0 Jul 24 10:00:30.144678 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.144449 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerDied","Data":"438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6"} Jul 24 10:00:30.144678 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.144512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerDied","Data":"bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e"} Jul 24 10:00:30.144678 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.144537 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerDied","Data":"3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e"} Jul 24 10:00:30.144678 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.144561 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerDied","Data":"b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e"} Jul 24 10:00:30.859432 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.859411 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 10:00:30.960260 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960156 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-tls-assets\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960260 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960197 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-volume\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960260 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960249 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-cluster-tls-config\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960514 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960306 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-main-db\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960514 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960331 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-web-config\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960514 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960373 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-trusted-ca-bundle\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960514 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960410 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-main-tls\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960514 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960442 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vn46\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-kube-api-access-9vn46\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960514 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960475 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960514 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960506 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-metrics-client-ca\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960827 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960554 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-out\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960827 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960588 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960827 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960614 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\" (UID: \"ae8c61bd-c744-4c93-b678-4de1d82e38ef\") " Jul 24 10:00:30.960827 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960670 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 10:00:30.960827 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.960756 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:00:30.961144 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.961079 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-main-db\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:30.961144 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.961101 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:30.961844 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.961519 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:00:30.963506 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.963473 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 10:00:30.963943 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.963916 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-volume" (OuterVolumeSpecName: "config-volume") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:30.964041 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.963958 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:30.964201 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.964177 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-kube-api-access-9vn46" (OuterVolumeSpecName: "kube-api-access-9vn46") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "kube-api-access-9vn46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 10:00:30.964376 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.964343 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:30.964376 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.964351 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-out" (OuterVolumeSpecName: "config-out") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 10:00:30.964477 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.964440 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:30.965107 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.965079 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:30.967941 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.967919 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:30.976115 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:30.976088 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-web-config" (OuterVolumeSpecName: "web-config") pod "ae8c61bd-c744-4c93-b678-4de1d82e38ef" (UID: "ae8c61bd-c744-4c93-b678-4de1d82e38ef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:31.062361 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062331 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-web-config\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062361 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062358 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-main-tls\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062372 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vn46\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-kube-api-access-9vn46\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062384 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062396 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae8c61bd-c744-4c93-b678-4de1d82e38ef-metrics-client-ca\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062417 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-out\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062428 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062441 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062452 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae8c61bd-c744-4c93-b678-4de1d82e38ef-tls-assets\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062464 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-config-volume\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.062546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.062475 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae8c61bd-c744-4c93-b678-4de1d82e38ef-cluster-tls-config\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:31.151274 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.151241 2563 generic.go:356] "Generic (PLEG): container finished" podID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerID="8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec" exitCode=0 Jul 24 10:00:31.151274 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.151264 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerDied","Data":"8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec"} Jul 24 10:00:31.151428 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.151323 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 10:00:31.151428 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.151337 2563 scope.go:117] "RemoveContainer" containerID="438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6" Jul 24 10:00:31.151428 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.151274 2563 generic.go:356] "Generic (PLEG): container finished" podID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerID="1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35" exitCode=0 Jul 24 10:00:31.151428 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.151326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerDied","Data":"1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35"} Jul 24 10:00:31.151607 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.151489 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae8c61bd-c744-4c93-b678-4de1d82e38ef","Type":"ContainerDied","Data":"0bc7ae512c734b184c28e206f9b31ff17217f156387e8a16e18589baf7dabc94"} Jul 24 10:00:31.159610 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.159596 2563 scope.go:117] "RemoveContainer" containerID="8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec" Jul 24 10:00:31.166420 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.166396 2563 scope.go:117] "RemoveContainer" containerID="bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e" Jul 24 10:00:31.172795 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.172778 2563 scope.go:117] "RemoveContainer" containerID="1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35" Jul 24 10:00:31.179062 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.179043 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 10:00:31.180495 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.180475 2563 scope.go:117] "RemoveContainer" containerID="3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e" Jul 24 10:00:31.183865 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.183845 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 10:00:31.187859 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.187841 2563 scope.go:117] "RemoveContainer" containerID="b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e" Jul 24 10:00:31.194672 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.194658 2563 scope.go:117] "RemoveContainer" containerID="d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19" Jul 24 10:00:31.201245 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.201211 2563 scope.go:117] "RemoveContainer" containerID="438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6" Jul 24 10:00:31.201508 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:31.201491 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6\": container with ID starting with 438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6 not found: ID does not exist" containerID="438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6" Jul 24 10:00:31.201554 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.201517 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6"} err="failed to get container status \"438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6\": rpc error: code = NotFound desc = could not find container \"438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6\": container with ID starting with 438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6 not found: ID does not exist" Jul 24 10:00:31.201554 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.201541 2563 scope.go:117] "RemoveContainer" containerID="8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec" Jul 24 10:00:31.201764 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:31.201746 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec\": container with ID starting with 8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec not found: ID does not exist" containerID="8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec" Jul 24 10:00:31.201825 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.201773 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec"} err="failed to get container status \"8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec\": rpc error: code = NotFound desc = could not find container \"8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec\": container with ID starting with 8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec not found: ID does not exist" Jul 24 10:00:31.201825 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.201794 2563 scope.go:117] "RemoveContainer" containerID="bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e" Jul 24 10:00:31.202015 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:31.201997 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e\": container with ID starting with bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e not found: ID does not exist" containerID="bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e" Jul 24 10:00:31.202054 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.202020 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e"} err="failed to get container status \"bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e\": rpc error: code = NotFound desc = could not find container \"bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e\": container with ID starting with bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e not found: ID does not exist" Jul 24 10:00:31.202054 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.202034 2563 scope.go:117] "RemoveContainer" containerID="1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35" Jul 24 10:00:31.202351 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:31.202332 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35\": container with ID starting with 1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35 not found: ID does not exist" containerID="1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35" Jul 24 10:00:31.202434 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.202357 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35"} err="failed to get container status \"1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35\": rpc error: code = NotFound desc = could not find container \"1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35\": container with ID starting with 1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35 not found: ID does not exist" Jul 24 10:00:31.202434 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.202379 2563 scope.go:117] "RemoveContainer" containerID="3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e" Jul 24 10:00:31.202604 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:31.202590 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e\": container with ID starting with 3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e not found: ID does not exist" containerID="3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e" Jul 24 10:00:31.202644 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.202607 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e"} err="failed to get container status \"3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e\": rpc error: code = NotFound desc = could not find container \"3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e\": container with ID starting with 3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e not found: ID does not exist" Jul 24 10:00:31.202644 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.202618 2563 scope.go:117] "RemoveContainer" containerID="b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e" Jul 24 10:00:31.202821 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:31.202806 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e\": container with ID starting with b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e not found: ID does not exist" containerID="b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e" Jul 24 10:00:31.202875 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.202827 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e"} err="failed to get container status \"b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e\": rpc error: code = NotFound desc = could not find container \"b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e\": container with ID starting with b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e not found: ID does not exist" Jul 24 10:00:31.202875 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.202847 2563 scope.go:117] "RemoveContainer" containerID="d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19" Jul 24 10:00:31.203040 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:31.203027 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19\": container with ID starting with d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19 not found: ID does not exist" containerID="d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19" Jul 24 10:00:31.203077 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203043 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19"} err="failed to get container status \"d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19\": rpc error: code = NotFound desc = could not find container \"d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19\": container with ID starting with d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19 not found: ID does not exist" Jul 24 10:00:31.203077 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203054 2563 scope.go:117] "RemoveContainer" containerID="438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6" Jul 24 10:00:31.203247 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203213 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6"} err="failed to get container status \"438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6\": rpc error: code = NotFound desc = could not find container \"438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6\": container with ID starting with 438367747e57cf2862adbf264830ccab727a749d82a2eb5791025a77782bc1e6 not found: ID does not exist" Jul 24 10:00:31.203291 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203256 2563 scope.go:117] "RemoveContainer" containerID="8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec" Jul 24 10:00:31.203467 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203451 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec"} err="failed to get container status \"8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec\": rpc error: code = NotFound desc = could not find container \"8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec\": container with ID starting with 8ab85171069c73d4d16c7a64e86cedf11dbad6b961ddd326cc3302c30fe5bdec not found: ID does not exist" Jul 24 10:00:31.203534 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203470 2563 scope.go:117] "RemoveContainer" containerID="bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e" Jul 24 10:00:31.203671 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203653 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e"} err="failed to get container status \"bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e\": rpc error: code = NotFound desc = could not find container \"bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e\": container with ID starting with bb1dc828fc08f00d3b2b8c24269ff32a7b0631b2d75b07a47ffac3eca580e84e not found: ID does not exist" Jul 24 10:00:31.203743 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203672 2563 scope.go:117] "RemoveContainer" containerID="1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35" Jul 24 10:00:31.203876 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203860 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35"} err="failed to get container status \"1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35\": rpc error: code = NotFound desc = could not find container \"1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35\": container with ID starting with 1385a8c6359b55b2e8c8cada41c9c47c8099b919e6f7736e42a6f31150f6ec35 not found: ID does not exist" Jul 24 10:00:31.203923 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.203877 2563 scope.go:117] "RemoveContainer" containerID="3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e" Jul 24 10:00:31.204124 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.204100 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e"} err="failed to get container status \"3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e\": rpc error: code = NotFound desc = could not find container \"3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e\": container with ID starting with 3c86fd7ed5b28fc8047ba150c34b3d3d47dd5dd26ebdf229d3f673dd7c96394e not found: ID does not exist" Jul 24 10:00:31.204211 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.204126 2563 scope.go:117] "RemoveContainer" containerID="b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e" Jul 24 10:00:31.204472 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.204431 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e"} err="failed to get container status \"b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e\": rpc error: code = NotFound desc = could not find container \"b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e\": container with ID starting with b8c6df8906b9b6890ab693ec764f898c958b0362d635e996c722af92b546f46e not found: ID does not exist" Jul 24 10:00:31.204472 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.204461 2563 scope.go:117] "RemoveContainer" containerID="d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19" Jul 24 10:00:31.204747 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:31.204723 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19"} err="failed to get container status \"d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19\": rpc error: code = NotFound desc = could not find container \"d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19\": container with ID starting with d5a83268f54a82255289b8faf155d98d629d66b16744c3a824139124a6d30a19 not found: ID does not exist" Jul 24 10:00:32.170874 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:32.170833 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" path="/var/lib/kubelet/pods/ae8c61bd-c744-4c93-b678-4de1d82e38ef/volumes" Jul 24 10:00:33.872698 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:33.872662 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 10:00:33.873631 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:33.873598 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="prometheus" containerID="cri-o://aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" gracePeriod=600 Jul 24 10:00:33.873817 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:33.873781 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" gracePeriod=600 Jul 24 10:00:33.874038 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:33.873874 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy" containerID="cri-o://4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" gracePeriod=600 Jul 24 10:00:33.874142 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:33.873898 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy-web" containerID="cri-o://43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" gracePeriod=600 Jul 24 10:00:33.874264 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:33.873914 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="thanos-sidecar" containerID="cri-o://2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" gracePeriod=600 Jul 24 10:00:33.874699 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:33.873929 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="config-reloader" containerID="cri-o://fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" gracePeriod=600 Jul 24 10:00:34.127094 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.127036 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.171351 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.171309 2563 generic.go:356] "Generic (PLEG): container finished" podID="28629791-6b40-4df4-8384-e3c52a886a1e" containerID="bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" exitCode=0 Jul 24 10:00:34.171351 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.171340 2563 generic.go:356] "Generic (PLEG): container finished" podID="28629791-6b40-4df4-8384-e3c52a886a1e" containerID="4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" exitCode=0 Jul 24 10:00:34.171351 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.171349 2563 generic.go:356] "Generic (PLEG): container finished" podID="28629791-6b40-4df4-8384-e3c52a886a1e" containerID="43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" exitCode=0 Jul 24 10:00:34.171351 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.171357 2563 generic.go:356] "Generic (PLEG): container finished" podID="28629791-6b40-4df4-8384-e3c52a886a1e" containerID="2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" exitCode=0 Jul 24 10:00:34.171699 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.171364 2563 generic.go:356] "Generic (PLEG): container finished" podID="28629791-6b40-4df4-8384-e3c52a886a1e" containerID="fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" exitCode=0 Jul 24 10:00:34.171699 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.171373 2563 generic.go:356] "Generic (PLEG): container finished" podID="28629791-6b40-4df4-8384-e3c52a886a1e" containerID="aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" exitCode=0 Jul 24 10:00:34.171699 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.171555 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.175400 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.175373 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerDied","Data":"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a"} Jul 24 10:00:34.175496 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.175441 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerDied","Data":"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91"} Jul 24 10:00:34.175496 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.175469 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerDied","Data":"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573"} Jul 24 10:00:34.175569 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.175495 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerDied","Data":"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817"} Jul 24 10:00:34.175569 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.175520 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerDied","Data":"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb"} Jul 24 10:00:34.175569 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.175527 2563 scope.go:117] "RemoveContainer" containerID="bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" Jul 24 10:00:34.175569 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.175555 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerDied","Data":"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15"} Jul 24 10:00:34.175690 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.175584 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28629791-6b40-4df4-8384-e3c52a886a1e","Type":"ContainerDied","Data":"bf7605f62a607ae5f9c0e2fcabfcfad31c00952f6b5167a24f9a2c182ed99f55"} Jul 24 10:00:34.190719 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.190694 2563 scope.go:117] "RemoveContainer" containerID="4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" Jul 24 10:00:34.199223 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.199199 2563 scope.go:117] "RemoveContainer" containerID="43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" Jul 24 10:00:34.207964 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.207948 2563 scope.go:117] "RemoveContainer" containerID="2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" Jul 24 10:00:34.215331 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.215307 2563 scope.go:117] "RemoveContainer" containerID="fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" Jul 24 10:00:34.222381 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.222364 2563 scope.go:117] "RemoveContainer" containerID="aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" Jul 24 10:00:34.229800 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.229784 2563 scope.go:117] "RemoveContainer" containerID="77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e" Jul 24 10:00:34.236360 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.236345 2563 scope.go:117] "RemoveContainer" containerID="bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" Jul 24 10:00:34.236624 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:34.236604 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": container with ID starting with bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a not found: ID does not exist" containerID="bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" Jul 24 10:00:34.236681 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.236634 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a"} err="failed to get container status \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": rpc error: code = NotFound desc = could not find container \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": container with ID starting with bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a not found: ID does not exist" Jul 24 10:00:34.236681 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.236652 2563 scope.go:117] "RemoveContainer" containerID="4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" Jul 24 10:00:34.236878 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:34.236863 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": container with ID starting with 4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91 not found: ID does not exist" containerID="4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" Jul 24 10:00:34.236919 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.236882 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91"} err="failed to get container status \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": rpc error: code = NotFound desc = could not find container \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": container with ID starting with 4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91 not found: ID does not exist" Jul 24 10:00:34.236919 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.236909 2563 scope.go:117] "RemoveContainer" containerID="43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" Jul 24 10:00:34.237118 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:34.237102 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": container with ID starting with 43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573 not found: ID does not exist" containerID="43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" Jul 24 10:00:34.237157 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.237122 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573"} err="failed to get container status \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": rpc error: code = NotFound desc = could not find container \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": container with ID starting with 43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573 not found: ID does not exist" Jul 24 10:00:34.237157 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.237134 2563 scope.go:117] "RemoveContainer" containerID="2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" Jul 24 10:00:34.237406 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:34.237391 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": container with ID starting with 2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817 not found: ID does not exist" containerID="2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" Jul 24 10:00:34.237451 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.237411 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817"} err="failed to get container status \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": rpc error: code = NotFound desc = could not find container \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": container with ID starting with 2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817 not found: ID does not exist" Jul 24 10:00:34.237451 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.237423 2563 scope.go:117] "RemoveContainer" containerID="fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" Jul 24 10:00:34.237687 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:34.237661 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": container with ID starting with fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb not found: ID does not exist" containerID="fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" Jul 24 10:00:34.237777 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.237694 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb"} err="failed to get container status \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": rpc error: code = NotFound desc = could not find container \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": container with ID starting with fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb not found: ID does not exist" Jul 24 10:00:34.237777 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.237710 2563 scope.go:117] "RemoveContainer" containerID="aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" Jul 24 10:00:34.237985 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:34.237969 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": container with ID starting with aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15 not found: ID does not exist" containerID="aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" Jul 24 10:00:34.238039 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.237994 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15"} err="failed to get container status \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": rpc error: code = NotFound desc = could not find container \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": container with ID starting with aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15 not found: ID does not exist" Jul 24 10:00:34.238039 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.238012 2563 scope.go:117] "RemoveContainer" containerID="77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e" Jul 24 10:00:34.238260 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:00:34.238241 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": container with ID starting with 77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e not found: ID does not exist" containerID="77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e" Jul 24 10:00:34.238322 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.238262 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e"} err="failed to get container status \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": rpc error: code = NotFound desc = could not find container \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": container with ID starting with 77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e not found: ID does not exist" Jul 24 10:00:34.238322 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.238282 2563 scope.go:117] "RemoveContainer" containerID="bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" Jul 24 10:00:34.238510 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.238492 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a"} err="failed to get container status \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": rpc error: code = NotFound desc = could not find container \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": container with ID starting with bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a not found: ID does not exist" Jul 24 10:00:34.238568 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.238510 2563 scope.go:117] "RemoveContainer" containerID="4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" Jul 24 10:00:34.238708 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.238690 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91"} err="failed to get container status \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": rpc error: code = NotFound desc = could not find container \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": container with ID starting with 4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91 not found: ID does not exist" Jul 24 10:00:34.238743 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.238712 2563 scope.go:117] "RemoveContainer" containerID="43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" Jul 24 10:00:34.238953 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.238934 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573"} err="failed to get container status \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": rpc error: code = NotFound desc = could not find container \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": container with ID starting with 43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573 not found: ID does not exist" Jul 24 10:00:34.239001 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.238953 2563 scope.go:117] "RemoveContainer" containerID="2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" Jul 24 10:00:34.239162 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239141 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817"} err="failed to get container status \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": rpc error: code = NotFound desc = could not find container \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": container with ID starting with 2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817 not found: ID does not exist" Jul 24 10:00:34.239162 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239162 2563 scope.go:117] "RemoveContainer" containerID="fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" Jul 24 10:00:34.239412 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239395 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb"} err="failed to get container status \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": rpc error: code = NotFound desc = could not find container \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": container with ID starting with fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb not found: ID does not exist" Jul 24 10:00:34.239412 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239412 2563 scope.go:117] "RemoveContainer" containerID="aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" Jul 24 10:00:34.239610 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239594 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15"} err="failed to get container status \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": rpc error: code = NotFound desc = could not find container \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": container with ID starting with aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15 not found: ID does not exist" Jul 24 10:00:34.239651 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239611 2563 scope.go:117] "RemoveContainer" containerID="77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e" Jul 24 10:00:34.239795 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239781 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e"} err="failed to get container status \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": rpc error: code = NotFound desc = could not find container \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": container with ID starting with 77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e not found: ID does not exist" Jul 24 10:00:34.239839 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239796 2563 scope.go:117] "RemoveContainer" containerID="bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" Jul 24 10:00:34.239980 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239965 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a"} err="failed to get container status \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": rpc error: code = NotFound desc = could not find container \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": container with ID starting with bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a not found: ID does not exist" Jul 24 10:00:34.240024 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.239980 2563 scope.go:117] "RemoveContainer" containerID="4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" Jul 24 10:00:34.240219 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.240201 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91"} err="failed to get container status \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": rpc error: code = NotFound desc = could not find container \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": container with ID starting with 4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91 not found: ID does not exist" Jul 24 10:00:34.240293 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.240221 2563 scope.go:117] "RemoveContainer" containerID="43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" Jul 24 10:00:34.240452 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.240427 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573"} err="failed to get container status \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": rpc error: code = NotFound desc = could not find container \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": container with ID starting with 43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573 not found: ID does not exist" Jul 24 10:00:34.240452 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.240444 2563 scope.go:117] "RemoveContainer" containerID="2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" Jul 24 10:00:34.240676 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.240656 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817"} err="failed to get container status \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": rpc error: code = NotFound desc = could not find container \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": container with ID starting with 2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817 not found: ID does not exist" Jul 24 10:00:34.240676 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.240677 2563 scope.go:117] "RemoveContainer" containerID="fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" Jul 24 10:00:34.240911 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.240893 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb"} err="failed to get container status \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": rpc error: code = NotFound desc = could not find container \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": container with ID starting with fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb not found: ID does not exist" Jul 24 10:00:34.240962 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.240912 2563 scope.go:117] "RemoveContainer" containerID="aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" Jul 24 10:00:34.241104 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.241084 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15"} err="failed to get container status \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": rpc error: code = NotFound desc = could not find container \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": container with ID starting with aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15 not found: ID does not exist" Jul 24 10:00:34.241175 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.241105 2563 scope.go:117] "RemoveContainer" containerID="77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e" Jul 24 10:00:34.241326 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.241307 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e"} err="failed to get container status \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": rpc error: code = NotFound desc = could not find container \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": container with ID starting with 77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e not found: ID does not exist" Jul 24 10:00:34.241385 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.241328 2563 scope.go:117] "RemoveContainer" containerID="bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" Jul 24 10:00:34.241546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.241527 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a"} err="failed to get container status \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": rpc error: code = NotFound desc = could not find container \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": container with ID starting with bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a not found: ID does not exist" Jul 24 10:00:34.241614 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.241548 2563 scope.go:117] "RemoveContainer" containerID="4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" Jul 24 10:00:34.241795 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.241779 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91"} err="failed to get container status \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": rpc error: code = NotFound desc = could not find container \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": container with ID starting with 4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91 not found: ID does not exist" Jul 24 10:00:34.241861 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.241798 2563 scope.go:117] "RemoveContainer" containerID="43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" Jul 24 10:00:34.242010 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.241995 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573"} err="failed to get container status \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": rpc error: code = NotFound desc = could not find container \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": container with ID starting with 43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573 not found: ID does not exist" Jul 24 10:00:34.242074 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.242011 2563 scope.go:117] "RemoveContainer" containerID="2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" Jul 24 10:00:34.242210 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.242191 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817"} err="failed to get container status \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": rpc error: code = NotFound desc = could not find container \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": container with ID starting with 2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817 not found: ID does not exist" Jul 24 10:00:34.242289 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.242213 2563 scope.go:117] "RemoveContainer" containerID="fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" Jul 24 10:00:34.242449 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.242431 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb"} err="failed to get container status \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": rpc error: code = NotFound desc = could not find container \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": container with ID starting with fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb not found: ID does not exist" Jul 24 10:00:34.242510 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.242450 2563 scope.go:117] "RemoveContainer" containerID="aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" Jul 24 10:00:34.242663 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.242645 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15"} err="failed to get container status \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": rpc error: code = NotFound desc = could not find container \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": container with ID starting with aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15 not found: ID does not exist" Jul 24 10:00:34.242707 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.242664 2563 scope.go:117] "RemoveContainer" containerID="77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e" Jul 24 10:00:34.242852 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.242837 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e"} err="failed to get container status \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": rpc error: code = NotFound desc = could not find container \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": container with ID starting with 77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e not found: ID does not exist" Jul 24 10:00:34.242890 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.242852 2563 scope.go:117] "RemoveContainer" containerID="bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" Jul 24 10:00:34.243024 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243010 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a"} err="failed to get container status \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": rpc error: code = NotFound desc = could not find container \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": container with ID starting with bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a not found: ID does not exist" Jul 24 10:00:34.243071 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243024 2563 scope.go:117] "RemoveContainer" containerID="4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" Jul 24 10:00:34.243226 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243210 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91"} err="failed to get container status \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": rpc error: code = NotFound desc = could not find container \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": container with ID starting with 4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91 not found: ID does not exist" Jul 24 10:00:34.243300 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243243 2563 scope.go:117] "RemoveContainer" containerID="43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" Jul 24 10:00:34.243479 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243459 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573"} err="failed to get container status \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": rpc error: code = NotFound desc = could not find container \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": container with ID starting with 43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573 not found: ID does not exist" Jul 24 10:00:34.243538 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243480 2563 scope.go:117] "RemoveContainer" containerID="2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" Jul 24 10:00:34.243676 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243659 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817"} err="failed to get container status \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": rpc error: code = NotFound desc = could not find container \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": container with ID starting with 2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817 not found: ID does not exist" Jul 24 10:00:34.243744 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243677 2563 scope.go:117] "RemoveContainer" containerID="fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" Jul 24 10:00:34.243869 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243849 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb"} err="failed to get container status \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": rpc error: code = NotFound desc = could not find container \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": container with ID starting with fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb not found: ID does not exist" Jul 24 10:00:34.243914 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.243871 2563 scope.go:117] "RemoveContainer" containerID="aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" Jul 24 10:00:34.244065 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244048 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15"} err="failed to get container status \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": rpc error: code = NotFound desc = could not find container \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": container with ID starting with aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15 not found: ID does not exist" Jul 24 10:00:34.244122 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244066 2563 scope.go:117] "RemoveContainer" containerID="77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e" Jul 24 10:00:34.244289 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244261 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e"} err="failed to get container status \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": rpc error: code = NotFound desc = could not find container \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": container with ID starting with 77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e not found: ID does not exist" Jul 24 10:00:34.244289 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244289 2563 scope.go:117] "RemoveContainer" containerID="bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a" Jul 24 10:00:34.244494 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244467 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a"} err="failed to get container status \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": rpc error: code = NotFound desc = could not find container \"bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a\": container with ID starting with bae807db9468bc011b3824e7b0fcacc9db6aa412219b4fa8efd407f36764e94a not found: ID does not exist" Jul 24 10:00:34.244540 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244494 2563 scope.go:117] "RemoveContainer" containerID="4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91" Jul 24 10:00:34.244711 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244696 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91"} err="failed to get container status \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": rpc error: code = NotFound desc = could not find container \"4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91\": container with ID starting with 4a1e824c61c1b253aa2b87f9fb71f5b7d16c7ffbe94c1263335a7e572e73ec91 not found: ID does not exist" Jul 24 10:00:34.244764 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244712 2563 scope.go:117] "RemoveContainer" containerID="43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573" Jul 24 10:00:34.244948 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244931 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573"} err="failed to get container status \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": rpc error: code = NotFound desc = could not find container \"43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573\": container with ID starting with 43c0c4c5dc9f6c9c8589bc6997656037c1620888ade029f25cfa85bb4fc8f573 not found: ID does not exist" Jul 24 10:00:34.244997 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.244949 2563 scope.go:117] "RemoveContainer" containerID="2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817" Jul 24 10:00:34.245174 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.245158 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817"} err="failed to get container status \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": rpc error: code = NotFound desc = could not find container \"2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817\": container with ID starting with 2055750fb277aacc6dac90637f433e4d331f928acc7e55cb82abe6512a471817 not found: ID does not exist" Jul 24 10:00:34.245211 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.245175 2563 scope.go:117] "RemoveContainer" containerID="fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb" Jul 24 10:00:34.245421 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.245404 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb"} err="failed to get container status \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": rpc error: code = NotFound desc = could not find container \"fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb\": container with ID starting with fdc96d1788db059b32b3d496ea726f98b79f6b357a89b6130a25cca090ae5efb not found: ID does not exist" Jul 24 10:00:34.245490 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.245423 2563 scope.go:117] "RemoveContainer" containerID="aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15" Jul 24 10:00:34.245648 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.245632 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15"} err="failed to get container status \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": rpc error: code = NotFound desc = could not find container \"aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15\": container with ID starting with aa48483927e8c2986a166c415bc8b5abf3b41cbc33ae50f9c04e068f1e237a15 not found: ID does not exist" Jul 24 10:00:34.245690 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.245648 2563 scope.go:117] "RemoveContainer" containerID="77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e" Jul 24 10:00:34.245856 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.245840 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e"} err="failed to get container status \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": rpc error: code = NotFound desc = could not find container \"77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e\": container with ID starting with 77da877730adeb5b545fabff887200eb9612f2a68bf1836c154aec6322dbfa4e not found: ID does not exist" Jul 24 10:00:34.288723 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.288693 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-config\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.288815 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.288728 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-2\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.288815 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.288752 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-serving-certs-ca-bundle\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.288815 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.288778 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-thanos-prometheus-http-client-file\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.288970 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.288821 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-0\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.288970 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.288852 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-config-out\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.288970 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.288883 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-metrics-client-ca\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.288970 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.288937 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-metrics-client-certs\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289155 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289006 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289155 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289032 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-tls-assets\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289155 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289060 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x79mf\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-kube-api-access-x79mf\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289155 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289103 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-1\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289155 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289105 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:00:34.289155 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289133 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-kube-rbac-proxy\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289155 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289138 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:00:34.289501 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289159 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-trusted-ca-bundle\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289501 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289187 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-grpc-tls\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289501 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289220 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289501 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289268 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-db\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289501 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289291 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-web-config\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289501 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289344 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-tls\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289501 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289393 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-kubelet-serving-ca-bundle\") pod \"28629791-6b40-4df4-8384-e3c52a886a1e\" (UID: \"28629791-6b40-4df4-8384-e3c52a886a1e\") " Jul 24 10:00:34.289501 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289480 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:00:34.289868 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289605 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:00:34.289868 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289784 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.289868 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289811 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.289868 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289811 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:00:34.289868 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.289827 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.290797 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.290567 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:00:34.290797 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.290575 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:00:34.292196 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.292157 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 10:00:34.292332 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.292206 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-config-out" (OuterVolumeSpecName: "config-out") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 10:00:34.293257 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.293212 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:34.293352 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.293310 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:34.293454 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.293419 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-config" (OuterVolumeSpecName: "config") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:34.293558 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.293516 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:34.293874 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.293850 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-kube-api-access-x79mf" (OuterVolumeSpecName: "kube-api-access-x79mf") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "kube-api-access-x79mf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 10:00:34.294309 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.294285 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:34.294398 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.294318 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 10:00:34.294615 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.294601 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:34.295152 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.295130 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:34.295152 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.295140 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:34.303494 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.303474 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-web-config" (OuterVolumeSpecName: "web-config") pod "28629791-6b40-4df4-8384-e3c52a886a1e" (UID: "28629791-6b40-4df4-8384-e3c52a886a1e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:00:34.390623 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390560 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390623 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390584 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-db\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390623 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390595 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-web-config\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390623 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390605 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390623 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390613 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390623 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390622 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-config\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390631 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390639 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390647 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28629791-6b40-4df4-8384-e3c52a886a1e-config-out\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390656 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-configmap-metrics-client-ca\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390664 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-metrics-client-certs\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390672 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390680 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-tls-assets\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390688 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x79mf\" (UniqueName: \"kubernetes.io/projected/28629791-6b40-4df4-8384-e3c52a886a1e-kube-api-access-x79mf\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390695 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-kube-rbac-proxy\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390703 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28629791-6b40-4df4-8384-e3c52a886a1e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.390894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.390711 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28629791-6b40-4df4-8384-e3c52a886a1e-secret-grpc-tls\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:00:34.495996 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.495969 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 10:00:34.503222 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.503202 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 10:00:34.536493 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536469 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 10:00:34.536866 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536847 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy-web" Jul 24 10:00:34.536866 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536867 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy-web" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536877 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="init-config-reloader" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536883 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="init-config-reloader" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536889 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy-metric" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536895 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy-metric" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536904 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddd1d45-7519-46f9-adc5-cec86be6c470" containerName="console" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536910 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddd1d45-7519-46f9-adc5-cec86be6c470" containerName="console" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536916 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="config-reloader" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536922 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="config-reloader" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536935 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="init-config-reloader" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536944 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="init-config-reloader" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536955 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="prom-label-proxy" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536959 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="prom-label-proxy" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536967 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="thanos-sidecar" Jul 24 10:00:34.536971 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536972 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="thanos-sidecar" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536978 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy-thanos" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536983 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy-thanos" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536988 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.536993 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537001 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="config-reloader" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537006 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="config-reloader" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537013 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537017 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537022 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="prometheus" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537026 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="prometheus" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537034 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="alertmanager" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537038 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="alertmanager" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537045 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy-web" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537051 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy-web" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537095 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy-web" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537103 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="config-reloader" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537107 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537112 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="config-reloader" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537118 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="thanos-sidecar" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537124 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="kube-rbac-proxy-metric" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537129 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fddd1d45-7519-46f9-adc5-cec86be6c470" containerName="console" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537134 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="alertmanager" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537139 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy-thanos" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537143 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="prometheus" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537148 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy-web" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537153 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" containerName="kube-rbac-proxy" Jul 24 10:00:34.537362 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.537159 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae8c61bd-c744-4c93-b678-4de1d82e38ef" containerName="prom-label-proxy" Jul 24 10:00:34.542836 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.542821 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.546165 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.546146 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 10:00:34.546165 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.546161 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 10:00:34.546451 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.546430 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 10:00:34.546546 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.546456 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 10:00:34.549736 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.549718 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 10:00:34.549929 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.549809 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 10:00:34.549995 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.549810 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 10:00:34.550048 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.549899 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 10:00:34.550048 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.550023 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 10:00:34.550158 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.550144 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 10:00:34.550271 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.550250 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 10:00:34.550271 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.550250 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 10:00:34.550679 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.550666 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hvstv\"" Jul 24 10:00:34.550749 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.550683 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 10:00:34.550908 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.550889 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5n702dsb04nqb\"" Jul 24 10:00:34.552531 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.552510 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 10:00:34.555304 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.555290 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 10:00:34.562429 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.562395 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 10:00:34.692956 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.692870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.692956 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.692903 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.692956 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.692921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.692956 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.692940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psr2n\" (UniqueName: \"kubernetes.io/projected/edf5b60e-a73b-4d23-86a2-865ff3127cf4-kube-api-access-psr2n\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693219 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693219 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693219 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693219 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693071 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-config\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693219 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edf5b60e-a73b-4d23-86a2-865ff3127cf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693219 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693219 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693279 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edf5b60e-a73b-4d23-86a2-865ff3127cf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693499 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.693611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.693526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.794841 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.794797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.794841 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.794844 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.795005 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.794864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.795005 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.794973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.795121 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.795007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.795121 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.795028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.795121 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.795063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.795373 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.795164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.795574 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.795555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.795785 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.795729 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.795974 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.795955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psr2n\" (UniqueName: \"kubernetes.io/projected/edf5b60e-a73b-4d23-86a2-865ff3127cf4-kube-api-access-psr2n\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.796117 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.796101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.796225 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.796210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.796373 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.796358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.796467 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.796454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-config\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.796558 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.796546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edf5b60e-a73b-4d23-86a2-865ff3127cf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.796657 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.796642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.796766 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.796751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.796886 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.796870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.796979 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.796965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.797074 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.797060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edf5b60e-a73b-4d23-86a2-865ff3127cf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.797158 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.797133 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.797217 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.795997 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.797217 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.795570 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.798930 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.798269 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.798930 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.798375 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.798930 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.798503 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.798930 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.798638 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.798930 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.798649 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.800583 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.798796 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.800583 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.799612 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.800583 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.799722 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.800583 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.799954 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.800583 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.800528 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/edf5b60e-a73b-4d23-86a2-865ff3127cf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.800859 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.800805 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.801353 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.801330 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edf5b60e-a73b-4d23-86a2-865ff3127cf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.802710 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.802679 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.802924 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.802906 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/edf5b60e-a73b-4d23-86a2-865ff3127cf4-config\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.803828 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.803808 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edf5b60e-a73b-4d23-86a2-865ff3127cf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.809008 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.808983 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psr2n\" (UniqueName: \"kubernetes.io/projected/edf5b60e-a73b-4d23-86a2-865ff3127cf4-kube-api-access-psr2n\") pod \"prometheus-k8s-0\" (UID: \"edf5b60e-a73b-4d23-86a2-865ff3127cf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.853168 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.853144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:34.994352 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:34.994278 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 10:00:34.996963 ip-10-0-131-23 kubenswrapper[2563]: W0724 10:00:34.996933 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf5b60e_a73b_4d23_86a2_865ff3127cf4.slice/crio-23ea7cf2c0aafabf38dfcf8cc592b5dffdb8f38975d39f0c0a59ec9e8ce367ec WatchSource:0}: Error finding container 23ea7cf2c0aafabf38dfcf8cc592b5dffdb8f38975d39f0c0a59ec9e8ce367ec: Status 404 returned error can't find the container with id 23ea7cf2c0aafabf38dfcf8cc592b5dffdb8f38975d39f0c0a59ec9e8ce367ec Jul 24 10:00:35.177156 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:35.177129 2563 generic.go:356] "Generic (PLEG): container finished" podID="edf5b60e-a73b-4d23-86a2-865ff3127cf4" containerID="bf04fd22cec2221233c3e9f01ac5a878facf5765661a6f9d86ad987aa5cf85c5" exitCode=0 Jul 24 10:00:35.177295 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:35.177204 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"edf5b60e-a73b-4d23-86a2-865ff3127cf4","Type":"ContainerDied","Data":"bf04fd22cec2221233c3e9f01ac5a878facf5765661a6f9d86ad987aa5cf85c5"} Jul 24 10:00:35.177343 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:35.177302 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"edf5b60e-a73b-4d23-86a2-865ff3127cf4","Type":"ContainerStarted","Data":"23ea7cf2c0aafabf38dfcf8cc592b5dffdb8f38975d39f0c0a59ec9e8ce367ec"} Jul 24 10:00:36.171848 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:36.171775 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28629791-6b40-4df4-8384-e3c52a886a1e" path="/var/lib/kubelet/pods/28629791-6b40-4df4-8384-e3c52a886a1e/volumes" Jul 24 10:00:36.184265 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:36.184217 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"edf5b60e-a73b-4d23-86a2-865ff3127cf4","Type":"ContainerStarted","Data":"63709693fc86b55aebb0329583446fba6fba290ca4d5edd85b525ebeb5f6438f"} Jul 24 10:00:36.184404 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:36.184289 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"edf5b60e-a73b-4d23-86a2-865ff3127cf4","Type":"ContainerStarted","Data":"e2f346cf9ee6bc40e327b919e7e38972536a8ee2bbfee6746faaf799235ece58"} Jul 24 10:00:36.184404 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:36.184316 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"edf5b60e-a73b-4d23-86a2-865ff3127cf4","Type":"ContainerStarted","Data":"72af28cae15ef1bc6f0b0231be8cb91e6c5b1ef740928dd1c56c39b4dbb3b3f0"} Jul 24 10:00:36.184404 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:36.184340 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"edf5b60e-a73b-4d23-86a2-865ff3127cf4","Type":"ContainerStarted","Data":"de140acce9936d39dc786bfdd15286e2dc6429b16399bf58fd978fee4359cea2"} Jul 24 10:00:36.184404 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:36.184363 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"edf5b60e-a73b-4d23-86a2-865ff3127cf4","Type":"ContainerStarted","Data":"d629daf9260099d9258068b3f803fa32c0147b14d9fd66c9a43d5480eb453e6d"} Jul 24 10:00:36.184404 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:36.184385 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"edf5b60e-a73b-4d23-86a2-865ff3127cf4","Type":"ContainerStarted","Data":"fe370de9330127d39846dfbf9744d1474a23758c463157395864dd0549140e26"} Jul 24 10:00:36.224378 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:36.224330 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.20547072 podStartE2EDuration="2.224311431s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.840711ms" isStatefulPod=false podCreationTimestamp="2026-07-24 10:00:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 10:00:36.222535016 +0000 UTC m=+230.632022092" watchObservedRunningTime="2026-07-24 10:00:36.224311431 +0000 UTC m=+230.633798511" Jul 24 10:00:39.853817 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:39.853784 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:00:55.245611 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:00:55.245576 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564cc8ff5f-w62bk"] Jul 24 10:01:20.270876 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.270785 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-564cc8ff5f-w62bk" podUID="ee2990bc-41f7-4a25-92f0-d285d0d2babf" containerName="console" containerID="cri-o://d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4" gracePeriod=15 Jul 24 10:01:20.501355 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.501332 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 10:01:20.572804 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.572781 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-trusted-ca-bundle\") pod \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " Jul 24 10:01:20.572953 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.572809 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-service-ca\") pod \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " Jul 24 10:01:20.572953 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.572832 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-serving-cert\") pod \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " Jul 24 10:01:20.572953 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.572851 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-config\") pod \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " Jul 24 10:01:20.572953 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.572875 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-oauth-config\") pod \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " Jul 24 10:01:20.572953 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.572911 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq7ls\" (UniqueName: \"kubernetes.io/projected/ee2990bc-41f7-4a25-92f0-d285d0d2babf-kube-api-access-hq7ls\") pod \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " Jul 24 10:01:20.573220 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.572957 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-oauth-serving-cert\") pod \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\" (UID: \"ee2990bc-41f7-4a25-92f0-d285d0d2babf\") " Jul 24 10:01:20.573308 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.573270 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ee2990bc-41f7-4a25-92f0-d285d0d2babf" (UID: "ee2990bc-41f7-4a25-92f0-d285d0d2babf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:01:20.573398 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.573280 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-service-ca" (OuterVolumeSpecName: "service-ca") pod "ee2990bc-41f7-4a25-92f0-d285d0d2babf" (UID: "ee2990bc-41f7-4a25-92f0-d285d0d2babf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:01:20.573447 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.573296 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-config" (OuterVolumeSpecName: "console-config") pod "ee2990bc-41f7-4a25-92f0-d285d0d2babf" (UID: "ee2990bc-41f7-4a25-92f0-d285d0d2babf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:01:20.573532 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.573491 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ee2990bc-41f7-4a25-92f0-d285d0d2babf" (UID: "ee2990bc-41f7-4a25-92f0-d285d0d2babf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:01:20.575174 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.575151 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ee2990bc-41f7-4a25-92f0-d285d0d2babf" (UID: "ee2990bc-41f7-4a25-92f0-d285d0d2babf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:01:20.575174 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.575164 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee2990bc-41f7-4a25-92f0-d285d0d2babf-kube-api-access-hq7ls" (OuterVolumeSpecName: "kube-api-access-hq7ls") pod "ee2990bc-41f7-4a25-92f0-d285d0d2babf" (UID: "ee2990bc-41f7-4a25-92f0-d285d0d2babf"). InnerVolumeSpecName "kube-api-access-hq7ls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 10:01:20.575332 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.575170 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ee2990bc-41f7-4a25-92f0-d285d0d2babf" (UID: "ee2990bc-41f7-4a25-92f0-d285d0d2babf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:01:20.674171 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.674141 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-config\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:01:20.674171 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.674167 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-oauth-config\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:01:20.674349 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.674181 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq7ls\" (UniqueName: \"kubernetes.io/projected/ee2990bc-41f7-4a25-92f0-d285d0d2babf-kube-api-access-hq7ls\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:01:20.674349 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.674195 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-oauth-serving-cert\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:01:20.674349 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.674207 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-trusted-ca-bundle\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:01:20.674349 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.674219 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2990bc-41f7-4a25-92f0-d285d0d2babf-service-ca\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:01:20.674349 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:20.674255 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2990bc-41f7-4a25-92f0-d285d0d2babf-console-serving-cert\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:01:21.351152 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:21.351121 2563 generic.go:356] "Generic (PLEG): container finished" podID="ee2990bc-41f7-4a25-92f0-d285d0d2babf" containerID="d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4" exitCode=0 Jul 24 10:01:21.351566 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:21.351165 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564cc8ff5f-w62bk" Jul 24 10:01:21.351566 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:21.351208 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564cc8ff5f-w62bk" event={"ID":"ee2990bc-41f7-4a25-92f0-d285d0d2babf","Type":"ContainerDied","Data":"d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4"} Jul 24 10:01:21.351566 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:21.351269 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564cc8ff5f-w62bk" event={"ID":"ee2990bc-41f7-4a25-92f0-d285d0d2babf","Type":"ContainerDied","Data":"2c6d05831ddd93e0ec2fb4059ff6429ae0750261bc811797affcb4c42503a0a4"} Jul 24 10:01:21.351566 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:21.351293 2563 scope.go:117] "RemoveContainer" containerID="d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4" Jul 24 10:01:21.359958 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:21.359942 2563 scope.go:117] "RemoveContainer" containerID="d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4" Jul 24 10:01:21.360195 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:01:21.360177 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4\": container with ID starting with d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4 not found: ID does not exist" containerID="d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4" Jul 24 10:01:21.360262 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:21.360204 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4"} err="failed to get container status \"d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4\": rpc error: code = NotFound desc = could not find container \"d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4\": container with ID starting with d5d090210c3aa3324f573621402ea24000cd81a6c4bfdd485711e4dded7d9bc4 not found: ID does not exist" Jul 24 10:01:21.372617 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:21.372588 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564cc8ff5f-w62bk"] Jul 24 10:01:21.377117 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:21.377099 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-564cc8ff5f-w62bk"] Jul 24 10:01:22.172191 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:22.172160 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee2990bc-41f7-4a25-92f0-d285d0d2babf" path="/var/lib/kubelet/pods/ee2990bc-41f7-4a25-92f0-d285d0d2babf/volumes" Jul 24 10:01:34.853287 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:34.853259 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:01:34.869342 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:34.869320 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:01:35.423905 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:35.423878 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 10:01:46.018212 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:01:46.018185 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 10:03:25.427844 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.427812 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx"] Jul 24 10:03:25.428318 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.428093 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee2990bc-41f7-4a25-92f0-d285d0d2babf" containerName="console" Jul 24 10:03:25.428318 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.428103 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee2990bc-41f7-4a25-92f0-d285d0d2babf" containerName="console" Jul 24 10:03:25.428318 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.428163 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee2990bc-41f7-4a25-92f0-d285d0d2babf" containerName="console" Jul 24 10:03:25.430941 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.430924 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" Jul 24 10:03:25.433370 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.433348 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 10:03:25.433997 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.433979 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-prb4k\"" Jul 24 10:03:25.434075 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.433982 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 10:03:25.441738 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.441719 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx"] Jul 24 10:03:25.540350 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.540314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9xdb\" (UniqueName: \"kubernetes.io/projected/f36a54c4-0b02-4d21-ac72-7471c116ea3f-kube-api-access-n9xdb\") pod \"cert-manager-cainjector-559cdd8c87-fq7jx\" (UID: \"f36a54c4-0b02-4d21-ac72-7471c116ea3f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" Jul 24 10:03:25.540470 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.540378 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f36a54c4-0b02-4d21-ac72-7471c116ea3f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fq7jx\" (UID: \"f36a54c4-0b02-4d21-ac72-7471c116ea3f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" Jul 24 10:03:25.641100 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.641076 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9xdb\" (UniqueName: \"kubernetes.io/projected/f36a54c4-0b02-4d21-ac72-7471c116ea3f-kube-api-access-n9xdb\") pod \"cert-manager-cainjector-559cdd8c87-fq7jx\" (UID: \"f36a54c4-0b02-4d21-ac72-7471c116ea3f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" Jul 24 10:03:25.641212 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.641122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f36a54c4-0b02-4d21-ac72-7471c116ea3f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fq7jx\" (UID: \"f36a54c4-0b02-4d21-ac72-7471c116ea3f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" Jul 24 10:03:25.649578 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.649555 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f36a54c4-0b02-4d21-ac72-7471c116ea3f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fq7jx\" (UID: \"f36a54c4-0b02-4d21-ac72-7471c116ea3f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" Jul 24 10:03:25.649676 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.649612 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9xdb\" (UniqueName: \"kubernetes.io/projected/f36a54c4-0b02-4d21-ac72-7471c116ea3f-kube-api-access-n9xdb\") pod \"cert-manager-cainjector-559cdd8c87-fq7jx\" (UID: \"f36a54c4-0b02-4d21-ac72-7471c116ea3f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" Jul 24 10:03:25.739191 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.739107 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" Jul 24 10:03:25.875847 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.875817 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx"] Jul 24 10:03:25.879175 ip-10-0-131-23 kubenswrapper[2563]: W0724 10:03:25.879149 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf36a54c4_0b02_4d21_ac72_7471c116ea3f.slice/crio-0c6fe97f748daa5429858711f0171765d0d1743a0c97f523dc92f5c880cbd2eb WatchSource:0}: Error finding container 0c6fe97f748daa5429858711f0171765d0d1743a0c97f523dc92f5c880cbd2eb: Status 404 returned error can't find the container with id 0c6fe97f748daa5429858711f0171765d0d1743a0c97f523dc92f5c880cbd2eb Jul 24 10:03:25.881037 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:25.881007 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 10:03:26.826278 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:26.826221 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" event={"ID":"f36a54c4-0b02-4d21-ac72-7471c116ea3f","Type":"ContainerStarted","Data":"0c6fe97f748daa5429858711f0171765d0d1743a0c97f523dc92f5c880cbd2eb"} Jul 24 10:03:31.848880 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:31.848836 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" event={"ID":"f36a54c4-0b02-4d21-ac72-7471c116ea3f","Type":"ContainerStarted","Data":"64e1bd2a3e8f2a514408f9a4cbd0b7f48d72478405b59eb3ab85398cdfcd74c9"} Jul 24 10:03:31.868197 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:03:31.868153 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fq7jx" podStartSLOduration=1.69320447 podStartE2EDuration="6.868138997s" totalImagesPullingTime="5.174934527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 10:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 10:03:31.867387263 +0000 UTC m=+406.276874340" watchObservedRunningTime="2026-07-24 10:03:31.868138997 +0000 UTC m=+406.277626074" Jul 24 10:05:41.877385 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:41.877355 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb"] Jul 24 10:05:41.880651 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:41.880632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:41.884956 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:41.884933 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 24 10:05:41.885080 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:41.884972 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 24 10:05:41.885080 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:41.885009 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-97hnc\"" Jul 24 10:05:41.885080 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:41.885021 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 10:05:41.885470 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:41.885435 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 10:05:41.906658 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:41.906634 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb"] Jul 24 10:05:42.029822 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.029791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.029822 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.029824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv52f\" (UniqueName: \"kubernetes.io/projected/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kube-api-access-dv52f\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.030036 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.029855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.131298 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.131207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.131298 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.131271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv52f\" (UniqueName: \"kubernetes.io/projected/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kube-api-access-dv52f\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.131567 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.131545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.132359 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.132279 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.133952 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.133929 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.148430 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.148398 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv52f\" (UniqueName: \"kubernetes.io/projected/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kube-api-access-dv52f\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.190184 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.190155 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:42.325617 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:42.325594 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb"] Jul 24 10:05:42.328297 ip-10-0-131-23 kubenswrapper[2563]: W0724 10:05:42.328267 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0247bdc5_bc2f_4673_96c6_3423e8ee28eb.slice/crio-99f8c3bac5054046ebb3c3a4d5d77621f8c5cb0080e5c6092c784efacfabc60a WatchSource:0}: Error finding container 99f8c3bac5054046ebb3c3a4d5d77621f8c5cb0080e5c6092c784efacfabc60a: Status 404 returned error can't find the container with id 99f8c3bac5054046ebb3c3a4d5d77621f8c5cb0080e5c6092c784efacfabc60a Jul 24 10:05:43.334283 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:43.334252 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" event={"ID":"0247bdc5-bc2f-4673-96c6-3423e8ee28eb","Type":"ContainerStarted","Data":"99f8c3bac5054046ebb3c3a4d5d77621f8c5cb0080e5c6092c784efacfabc60a"} Jul 24 10:05:47.355328 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:47.355292 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" event={"ID":"0247bdc5-bc2f-4673-96c6-3423e8ee28eb","Type":"ContainerStarted","Data":"074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2"} Jul 24 10:05:47.355817 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:47.355364 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:05:47.375031 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:05:47.374979 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" podStartSLOduration=1.8736821639999999 podStartE2EDuration="6.374964624s" totalImagesPullingTime="4.50128246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 10:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 10:05:47.373617404 +0000 UTC m=+541.783104481" watchObservedRunningTime="2026-07-24 10:05:47.374964624 +0000 UTC m=+541.784451700" Jul 24 10:06:03.363949 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:06:03.363914 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:07:15.089816 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.089742 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb"] Jul 24 10:07:15.090335 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.089920 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" podUID="0247bdc5-bc2f-4673-96c6-3423e8ee28eb" containerName="manager" containerID="cri-o://074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2" gracePeriod=30 Jul 24 10:07:15.336575 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.336553 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:07:15.391793 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.391732 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kubeflow-trainer-config\") pod \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " Jul 24 10:07:15.391793 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.391788 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv52f\" (UniqueName: \"kubernetes.io/projected/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kube-api-access-dv52f\") pod \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " Jul 24 10:07:15.391934 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.391815 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-cert\") pod \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\" (UID: \"0247bdc5-bc2f-4673-96c6-3423e8ee28eb\") " Jul 24 10:07:15.394040 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.394000 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kube-api-access-dv52f" (OuterVolumeSpecName: "kube-api-access-dv52f") pod "0247bdc5-bc2f-4673-96c6-3423e8ee28eb" (UID: "0247bdc5-bc2f-4673-96c6-3423e8ee28eb"). InnerVolumeSpecName "kube-api-access-dv52f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 10:07:15.394166 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.394050 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-cert" (OuterVolumeSpecName: "cert") pod "0247bdc5-bc2f-4673-96c6-3423e8ee28eb" (UID: "0247bdc5-bc2f-4673-96c6-3423e8ee28eb"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 10:07:15.396054 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.396031 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "0247bdc5-bc2f-4673-96c6-3423e8ee28eb" (UID: "0247bdc5-bc2f-4673-96c6-3423e8ee28eb"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 10:07:15.493173 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.493136 2563 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kubeflow-trainer-config\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:07:15.493173 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.493169 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv52f\" (UniqueName: \"kubernetes.io/projected/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-kube-api-access-dv52f\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:07:15.493173 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.493178 2563 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0247bdc5-bc2f-4673-96c6-3423e8ee28eb-cert\") on node \"ip-10-0-131-23.ec2.internal\" DevicePath \"\"" Jul 24 10:07:15.689919 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.689837 2563 generic.go:356] "Generic (PLEG): container finished" podID="0247bdc5-bc2f-4673-96c6-3423e8ee28eb" containerID="074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2" exitCode=0 Jul 24 10:07:15.689919 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.689886 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" Jul 24 10:07:15.689919 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.689911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" event={"ID":"0247bdc5-bc2f-4673-96c6-3423e8ee28eb","Type":"ContainerDied","Data":"074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2"} Jul 24 10:07:15.690186 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.689940 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb" event={"ID":"0247bdc5-bc2f-4673-96c6-3423e8ee28eb","Type":"ContainerDied","Data":"99f8c3bac5054046ebb3c3a4d5d77621f8c5cb0080e5c6092c784efacfabc60a"} Jul 24 10:07:15.690186 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.689956 2563 scope.go:117] "RemoveContainer" containerID="074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2" Jul 24 10:07:15.698106 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.698091 2563 scope.go:117] "RemoveContainer" containerID="074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2" Jul 24 10:07:15.698393 ip-10-0-131-23 kubenswrapper[2563]: E0724 10:07:15.698375 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2\": container with ID starting with 074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2 not found: ID does not exist" containerID="074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2" Jul 24 10:07:15.698470 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.698398 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2"} err="failed to get container status \"074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2\": rpc error: code = NotFound desc = could not find container \"074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2\": container with ID starting with 074fadd6fb77b8ec346ea998a3de22be377996dc7d670a8aad200166c57b40c2 not found: ID does not exist" Jul 24 10:07:15.712206 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.712181 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb"] Jul 24 10:07:15.715755 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:15.715732 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-rwddb"] Jul 24 10:07:16.171452 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:07:16.171420 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0247bdc5-bc2f-4673-96c6-3423e8ee28eb" path="/var/lib/kubelet/pods/0247bdc5-bc2f-4673-96c6-3423e8ee28eb/volumes" Jul 24 10:08:12.810758 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.810723 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-djxrg/must-gather-2qpcd"] Jul 24 10:08:12.811137 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.811004 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0247bdc5-bc2f-4673-96c6-3423e8ee28eb" containerName="manager" Jul 24 10:08:12.811137 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.811014 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0247bdc5-bc2f-4673-96c6-3423e8ee28eb" containerName="manager" Jul 24 10:08:12.811137 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.811089 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0247bdc5-bc2f-4673-96c6-3423e8ee28eb" containerName="manager" Jul 24 10:08:12.814164 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.814148 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-djxrg/must-gather-2qpcd" Jul 24 10:08:12.816501 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.816486 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-djxrg\"/\"default-dockercfg-cqfwb\"" Jul 24 10:08:12.816580 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.816500 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-djxrg\"/\"kube-root-ca.crt\"" Jul 24 10:08:12.817837 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.817813 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-djxrg\"/\"openshift-service-ca.crt\"" Jul 24 10:08:12.827878 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.827856 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-djxrg/must-gather-2qpcd"] Jul 24 10:08:12.932487 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.932448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl29l\" (UniqueName: \"kubernetes.io/projected/cd6a9672-1a1e-426e-a676-8198c4e5e9a2-kube-api-access-kl29l\") pod \"must-gather-2qpcd\" (UID: \"cd6a9672-1a1e-426e-a676-8198c4e5e9a2\") " pod="openshift-must-gather-djxrg/must-gather-2qpcd" Jul 24 10:08:12.932667 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:12.932495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cd6a9672-1a1e-426e-a676-8198c4e5e9a2-must-gather-output\") pod \"must-gather-2qpcd\" (UID: \"cd6a9672-1a1e-426e-a676-8198c4e5e9a2\") " pod="openshift-must-gather-djxrg/must-gather-2qpcd" Jul 24 10:08:13.033108 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:13.033074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cd6a9672-1a1e-426e-a676-8198c4e5e9a2-must-gather-output\") pod \"must-gather-2qpcd\" (UID: \"cd6a9672-1a1e-426e-a676-8198c4e5e9a2\") " pod="openshift-must-gather-djxrg/must-gather-2qpcd" Jul 24 10:08:13.033257 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:13.033157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl29l\" (UniqueName: \"kubernetes.io/projected/cd6a9672-1a1e-426e-a676-8198c4e5e9a2-kube-api-access-kl29l\") pod \"must-gather-2qpcd\" (UID: \"cd6a9672-1a1e-426e-a676-8198c4e5e9a2\") " pod="openshift-must-gather-djxrg/must-gather-2qpcd" Jul 24 10:08:13.033443 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:13.033428 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cd6a9672-1a1e-426e-a676-8198c4e5e9a2-must-gather-output\") pod \"must-gather-2qpcd\" (UID: \"cd6a9672-1a1e-426e-a676-8198c4e5e9a2\") " pod="openshift-must-gather-djxrg/must-gather-2qpcd" Jul 24 10:08:13.045348 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:13.045322 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl29l\" (UniqueName: \"kubernetes.io/projected/cd6a9672-1a1e-426e-a676-8198c4e5e9a2-kube-api-access-kl29l\") pod \"must-gather-2qpcd\" (UID: \"cd6a9672-1a1e-426e-a676-8198c4e5e9a2\") " pod="openshift-must-gather-djxrg/must-gather-2qpcd" Jul 24 10:08:13.123451 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:13.123363 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-djxrg/must-gather-2qpcd" Jul 24 10:08:13.251567 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:13.251529 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-djxrg/must-gather-2qpcd"] Jul 24 10:08:13.255191 ip-10-0-131-23 kubenswrapper[2563]: W0724 10:08:13.255165 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd6a9672_1a1e_426e_a676_8198c4e5e9a2.slice/crio-5b04caa56bc0feae17f071a8fa002dc459f1ee7f23adc0a96404adf48f2a459a WatchSource:0}: Error finding container 5b04caa56bc0feae17f071a8fa002dc459f1ee7f23adc0a96404adf48f2a459a: Status 404 returned error can't find the container with id 5b04caa56bc0feae17f071a8fa002dc459f1ee7f23adc0a96404adf48f2a459a Jul 24 10:08:13.912214 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:13.912179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-djxrg/must-gather-2qpcd" event={"ID":"cd6a9672-1a1e-426e-a676-8198c4e5e9a2","Type":"ContainerStarted","Data":"5b04caa56bc0feae17f071a8fa002dc459f1ee7f23adc0a96404adf48f2a459a"} Jul 24 10:08:14.917946 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:14.917903 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-djxrg/must-gather-2qpcd" event={"ID":"cd6a9672-1a1e-426e-a676-8198c4e5e9a2","Type":"ContainerStarted","Data":"52d2e511390251b6970871c19dc15ac6d7dd2f2de2d1ff07f2cb802eeb73af68"} Jul 24 10:08:14.918326 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:14.917954 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-djxrg/must-gather-2qpcd" event={"ID":"cd6a9672-1a1e-426e-a676-8198c4e5e9a2","Type":"ContainerStarted","Data":"3b70aeca5f3418153dfcef210fa4f15d85c64879efa7ce84e6dc9d12f0f645b3"} Jul 24 10:08:14.933488 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:14.933443 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-djxrg/must-gather-2qpcd" podStartSLOduration=2.234074686 podStartE2EDuration="2.933426812s" totalImagesPullingTime="699.352126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 10:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 10:08:14.93240691 +0000 UTC m=+689.341893988" watchObservedRunningTime="2026-07-24 10:08:14.933426812 +0000 UTC m=+689.342913888" Jul 24 10:08:15.347861 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:15.347831 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xsj4t_d853ec2c-9dca-41db-b642-4ae5d6dc99c8/global-pull-secret-syncer/0.log" Jul 24 10:08:15.439594 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:15.439569 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4jj2v_9f8c982d-76af-4557-b750-412e20b8f12a/konnectivity-agent/0.log" Jul 24 10:08:15.460074 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:15.460050 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-23.ec2.internal_3ff7e6d6dc372649b853c14fc595bb8f/haproxy/0.log" Jul 24 10:08:19.471272 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:19.471178 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pkjzq_fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa/kube-state-metrics/0.log" Jul 24 10:08:19.495685 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:19.495550 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pkjzq_fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa/kube-rbac-proxy-main/0.log" Jul 24 10:08:19.522046 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:19.521981 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pkjzq_fd59d9bb-60bc-46bc-acbf-d1d6342bf4aa/kube-rbac-proxy-self/0.log" Jul 24 10:08:19.816263 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:19.816215 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f67kn_05302515-8fb3-4249-8bdd-1161d88415e6/node-exporter/0.log" Jul 24 10:08:19.844635 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:19.844579 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f67kn_05302515-8fb3-4249-8bdd-1161d88415e6/kube-rbac-proxy/0.log" Jul 24 10:08:19.871285 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:19.871263 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f67kn_05302515-8fb3-4249-8bdd-1161d88415e6/init-textfile/0.log" Jul 24 10:08:19.904641 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:19.904611 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7whnt_c1edc951-d544-4257-aa8c-2a28abfa09f2/kube-rbac-proxy-main/0.log" Jul 24 10:08:19.933509 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:19.933481 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7whnt_c1edc951-d544-4257-aa8c-2a28abfa09f2/kube-rbac-proxy-self/0.log" Jul 24 10:08:19.964297 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:19.964261 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7whnt_c1edc951-d544-4257-aa8c-2a28abfa09f2/openshift-state-metrics/0.log" Jul 24 10:08:20.006638 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.006604 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_edf5b60e-a73b-4d23-86a2-865ff3127cf4/prometheus/0.log" Jul 24 10:08:20.045106 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.045074 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_edf5b60e-a73b-4d23-86a2-865ff3127cf4/config-reloader/0.log" Jul 24 10:08:20.075968 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.075902 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_edf5b60e-a73b-4d23-86a2-865ff3127cf4/thanos-sidecar/0.log" Jul 24 10:08:20.102920 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.102883 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_edf5b60e-a73b-4d23-86a2-865ff3127cf4/kube-rbac-proxy-web/0.log" Jul 24 10:08:20.129784 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.129764 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_edf5b60e-a73b-4d23-86a2-865ff3127cf4/kube-rbac-proxy/0.log" Jul 24 10:08:20.157739 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.157711 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_edf5b60e-a73b-4d23-86a2-865ff3127cf4/kube-rbac-proxy-thanos/0.log" Jul 24 10:08:20.198314 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.198286 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_edf5b60e-a73b-4d23-86a2-865ff3127cf4/init-config-reloader/0.log" Jul 24 10:08:20.241291 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.241257 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-v8sms_183b25df-3a2f-4b7a-97e5-aadbb5089e7c/prometheus-operator/0.log" Jul 24 10:08:20.269306 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.269274 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-v8sms_183b25df-3a2f-4b7a-97e5-aadbb5089e7c/kube-rbac-proxy/0.log" Jul 24 10:08:20.444370 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.444299 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c8f7cb99-vsvrt_88d69f8f-00c5-4559-8521-1c7adafc5966/thanos-query/0.log" Jul 24 10:08:20.468564 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.468517 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c8f7cb99-vsvrt_88d69f8f-00c5-4559-8521-1c7adafc5966/kube-rbac-proxy-web/0.log" Jul 24 10:08:20.504926 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.499070 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c8f7cb99-vsvrt_88d69f8f-00c5-4559-8521-1c7adafc5966/kube-rbac-proxy/0.log" Jul 24 10:08:20.526744 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.526712 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c8f7cb99-vsvrt_88d69f8f-00c5-4559-8521-1c7adafc5966/prom-label-proxy/0.log" Jul 24 10:08:20.566768 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.566704 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c8f7cb99-vsvrt_88d69f8f-00c5-4559-8521-1c7adafc5966/kube-rbac-proxy-rules/0.log" Jul 24 10:08:20.600309 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:20.600283 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c8f7cb99-vsvrt_88d69f8f-00c5-4559-8521-1c7adafc5966/kube-rbac-proxy-metrics/0.log" Jul 24 10:08:22.734433 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.734394 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl"] Jul 24 10:08:22.738126 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.738097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.747162 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.747134 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl"] Jul 24 10:08:22.826735 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.826703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgvqv\" (UniqueName: \"kubernetes.io/projected/2dd9b299-600d-49db-b133-c4a1dc8d9e98-kube-api-access-vgvqv\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.826930 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.826774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-proc\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.826930 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.826801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-sys\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.826930 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.826840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-lib-modules\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.826930 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.826856 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-podres\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.927788 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.927755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgvqv\" (UniqueName: \"kubernetes.io/projected/2dd9b299-600d-49db-b133-c4a1dc8d9e98-kube-api-access-vgvqv\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.927982 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.927810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-proc\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.927982 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.927868 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-proc\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.927982 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.927936 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-sys\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.928140 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.927985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-lib-modules\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.928140 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.928002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-podres\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.928140 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.928044 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-sys\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.928340 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.928145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-podres\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.928340 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.928145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dd9b299-600d-49db-b133-c4a1dc8d9e98-lib-modules\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:22.939805 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:22.939779 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgvqv\" (UniqueName: \"kubernetes.io/projected/2dd9b299-600d-49db-b133-c4a1dc8d9e98-kube-api-access-vgvqv\") pod \"perf-node-gather-daemonset-w8cwl\" (UID: \"2dd9b299-600d-49db-b133-c4a1dc8d9e98\") " pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:23.050784 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:23.050760 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:23.223194 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:23.223165 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl"] Jul 24 10:08:23.229463 ip-10-0-131-23 kubenswrapper[2563]: W0724 10:08:23.229433 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2dd9b299_600d_49db_b133_c4a1dc8d9e98.slice/crio-d00e0ea24bfbdba9b381ff6b635ade15bae03991f575664fd3816bdb25342096 WatchSource:0}: Error finding container d00e0ea24bfbdba9b381ff6b635ade15bae03991f575664fd3816bdb25342096: Status 404 returned error can't find the container with id d00e0ea24bfbdba9b381ff6b635ade15bae03991f575664fd3816bdb25342096 Jul 24 10:08:23.969438 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:23.969400 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" event={"ID":"2dd9b299-600d-49db-b133-c4a1dc8d9e98","Type":"ContainerStarted","Data":"253018e8519712e2dbe05100f0e731851b637d559fc584d57cb3ea79d69f417d"} Jul 24 10:08:23.969894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:23.969463 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" event={"ID":"2dd9b299-600d-49db-b133-c4a1dc8d9e98","Type":"ContainerStarted","Data":"d00e0ea24bfbdba9b381ff6b635ade15bae03991f575664fd3816bdb25342096"} Jul 24 10:08:23.969894 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:23.969876 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:23.990531 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:23.990489 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" podStartSLOduration=1.990476386 podStartE2EDuration="1.990476386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 10:08:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 10:08:23.98899454 +0000 UTC m=+698.398481616" watchObservedRunningTime="2026-07-24 10:08:23.990476386 +0000 UTC m=+698.399963462" Jul 24 10:08:24.350495 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:24.350455 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vqjvn_9fdaaa75-19aa-4893-bfda-859e275d1e49/dns/0.log" Jul 24 10:08:24.379557 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:24.379533 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vqjvn_9fdaaa75-19aa-4893-bfda-859e275d1e49/kube-rbac-proxy/0.log" Jul 24 10:08:24.436164 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:24.436143 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hw722_51252953-771c-415b-ac0c-aeda706ffb9c/dns-node-resolver/0.log" Jul 24 10:08:24.941299 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:24.941269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mltsd_7d9e1c55-0d7c-472d-a280-a625f562517c/node-ca/0.log" Jul 24 10:08:26.059755 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:26.059729 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m2h9d_8b2c779c-2d51-4384-a584-5939c4e381bd/serve-healthcheck-canary/0.log" Jul 24 10:08:26.590026 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:26.589997 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6f5tr_9c735757-85e4-4a1c-a3d5-e7506a1dae4b/kube-rbac-proxy/0.log" Jul 24 10:08:26.611888 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:26.611864 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6f5tr_9c735757-85e4-4a1c-a3d5-e7506a1dae4b/exporter/0.log" Jul 24 10:08:26.636201 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:26.636167 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6f5tr_9c735757-85e4-4a1c-a3d5-e7506a1dae4b/extractor/0.log" Jul 24 10:08:29.983017 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:29.982984 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-djxrg/perf-node-gather-daemonset-w8cwl" Jul 24 10:08:31.849073 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:31.849050 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mklcp_26c8dc3f-43de-48f5-bed7-07bed31e9b0e/migrator/0.log" Jul 24 10:08:31.873605 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:31.873583 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mklcp_26c8dc3f-43de-48f5-bed7-07bed31e9b0e/graceful-termination/0.log" Jul 24 10:08:33.271687 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:33.271661 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-56flc_06766f9a-f37b-424e-a5b0-00ab7cf2d0d1/kube-multus/0.log" Jul 24 10:08:33.558777 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:33.558749 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gm74q_d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a/kube-multus-additional-cni-plugins/0.log" Jul 24 10:08:33.589250 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:33.589206 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gm74q_d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a/egress-router-binary-copy/0.log" Jul 24 10:08:33.619490 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:33.619466 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gm74q_d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a/cni-plugins/0.log" Jul 24 10:08:33.647490 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:33.647460 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gm74q_d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a/bond-cni-plugin/0.log" Jul 24 10:08:33.673130 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:33.673097 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gm74q_d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a/routeoverride-cni/0.log" Jul 24 10:08:33.699679 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:33.699649 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gm74q_d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a/whereabouts-cni-bincopy/0.log" Jul 24 10:08:33.725604 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:33.725576 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gm74q_d09d5c1f-c0bb-4f57-83ce-0cf4c3f4873a/whereabouts-cni/0.log" Jul 24 10:08:34.016901 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:34.016873 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ptzdc_9eb06806-375e-4ad6-843e-2776aa98216c/network-metrics-daemon/0.log" Jul 24 10:08:34.045202 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:34.045173 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ptzdc_9eb06806-375e-4ad6-843e-2776aa98216c/kube-rbac-proxy/0.log" Jul 24 10:08:35.365588 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:35.365553 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r8zhm_9b7e7e9c-823b-4a00-aae8-c66e1f513ca3/ovn-controller/0.log" Jul 24 10:08:35.391142 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:35.391108 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r8zhm_9b7e7e9c-823b-4a00-aae8-c66e1f513ca3/ovn-acl-logging/0.log" Jul 24 10:08:35.419757 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:35.419735 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r8zhm_9b7e7e9c-823b-4a00-aae8-c66e1f513ca3/kube-rbac-proxy-node/0.log" Jul 24 10:08:35.444717 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:35.444677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r8zhm_9b7e7e9c-823b-4a00-aae8-c66e1f513ca3/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 10:08:35.468789 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:35.468772 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r8zhm_9b7e7e9c-823b-4a00-aae8-c66e1f513ca3/northd/0.log" Jul 24 10:08:35.508754 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:35.508725 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r8zhm_9b7e7e9c-823b-4a00-aae8-c66e1f513ca3/nbdb/0.log" Jul 24 10:08:35.533671 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:35.533636 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r8zhm_9b7e7e9c-823b-4a00-aae8-c66e1f513ca3/sbdb/0.log" Jul 24 10:08:35.575010 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:35.574972 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r8zhm_9b7e7e9c-823b-4a00-aae8-c66e1f513ca3/ovnkube-controller/0.log" Jul 24 10:08:36.634292 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:36.634262 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mbz9f_4659c7c2-c649-4d08-ad8d-67c9b955c4ea/network-check-target-container/0.log" Jul 24 10:08:37.639156 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:37.639126 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7zkzr_55b645c3-4f1e-40cc-88ce-a2809ea86e0e/iptables-alerter/0.log" Jul 24 10:08:38.401347 ip-10-0-131-23 kubenswrapper[2563]: I0724 10:08:38.401317 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8btcw_6294891b-7363-45f6-87da-96321c389002/tuned/0.log"